Mitigate "finish_reason": "RECITATION" error in VertexAI queries.

[DonggeLiu]

Some VertexAI queries fail due to citation filter, i.e., "finish_reason": "RECITATION".

There is no good mitigation except increasing the temperature or prompt engineering.
We might be able to avoid it later if the model allows us to configure the threshold.

[naourass]

I tried increasing the temperature and several prompt engineering "hacks" like inserting a long random phrase between short segments, but still getting tons for recitation errors.

[DonggeLiu]

I tried increasing the temperature and several prompt engineering "hacks" like inserting a long random phrase between short segments, but still getting tons for recitation errors.

Yep, I reckon that's from Gemini internal so the external hacks won't prevent this.