Currently you cannot override the default 60 seconds Idle timeout for a listener.

From the Cloud Console you can override here:

But there's no annotation to do the same.