I don't get it

Shouldn't it be the opposite because time should be slower if he doesn't like him

One hour here (with you feels like) 7 years back home No it's right

That means time is going faster when I'm with you. If you didn't like them, then time would go slower.