RT - SSL keep getting logged out

Hi there;

rt-3.4.4 , mod_perl2 , apache2 , mod_ssl , the OS is Gentoo and mysql 4
on a seperate server to the web interface.
trying to roll out rt-3.4.4 , it works fine on the first development
server with no ssl enabled, however on the stagging server with SSL it
keeps logging me out, there is no pattern or any particular link, I read
the previous thread and my problem is not IE specific I tried it on both
IE, and firefox the same problem …
Anyone had similar problem??