Just a quick post to keep folks up to date on where I am with this problem. I booked the car into Doncaster Audi today for a diagnostic on the random idle and jerky ride. I took the master tech out for a run up and down the M18 to find that the problem showed itself.
The master tech recalled a problem he had with a demo car which displayed the same sympoms, and was cured by replacing the ...............turbo!!! The regeneration cycle of the DPF appears to be a red herring, as it cannot do it unless the car is cruising. It is more likely that there is a leak and the pressure from the turbo is venting to atmosphere. This causes the engine to increase the revs to compensate.
Car is booked in, so I wil let folks know how it goes.
Also, he did mention that supermarket fuel is not the best in the world, and with the 170TDi being rather highly tuned, it only wants quality fuel.