The phase retrieval problem consists in the recovery of a complex-valued signal from the magnitudes of its Fourier transform. Restricting ourselves to the case of sparse structured signals f, which can be represented as a linear combination of N arbitrary translations of a given generator function, we show that almost all f can be recovered from ??(N²) intensity measurements |ℱ[f](ω)| up to trivial ambiguities.