hi,
Of course there is no problem if you want to travel to your destination places. But I would suggest check if you have enough many to travel as well as savings after it, because there will be people how is dependent on you or you are the only person in their life.
Make sure that once you are leaving your job, you should have enough experience that you can get a job easily after you finish up with your travelling because you need to sustain for the rest of your life with talking care of your family.
So take your decision wisely and if you are sorted enough with this, then there wont be any problem if you quit your job.