The coach is quite practical, but the journey is quite long, almost 2 hours since it has to stop at the checkpoint for quite some time, to allow its passengers to clear the immigration.
If you're in a hurry, then taxi is the best option. You can take the shared taxi from Queen Street terminal, and then change to a local JB taxi once you reach JB downtown.
