Parag, welcome to
Java Ranch!
Most app servers (you never said which one!) do lazy loading of database connections. Thus no connections are made until the first request needs a connection,at which point the minimum number of specified connections are created in a pool and one is given to the requestor.
Another significant startup issue is that any JSPs (or similar web page building mechanisms) have to have their Java code generated and compiled.