With a controller in port 1 when an Infinity is installed, the PS2 will boot normally.
When there is no controller in port 1, the console will scan the port for 15 seconds (I timed it at 18 personally

) and then the console will reboot as normal. That 15 seconds take a long time when you watch it, lol. However, what you are observing is perfectly normal