Open the Transfers window and check the column Status for the file which is not being downloaded.
If the file is Queued by you, make sure you have maximized the number of Downloads : Options > Traffic > Downloads/Total maximum=Max.
If the file is Queued by a contact, just wait until your download reaches the top of your contact upload list.