Not necessarily. A passport with no stamps is not an automatic minus, and you can still get a visa.
The basic documents consist of:
- Your passport, proof of employment and finances, flight details and your planned itinerary.
- Your job and income must be explainable, and your finances must fit the trip.
- Your itinerary should be clear and realistic day by day, and all information in the application must be consistent.
- The purpose of your trip must match the type of visa you apply for.
Note: Don't fake a travel history or give false information to make your application look better. The Japanese Embassy states clearly that applications with forged documents or false statements will be refused.
If you're confident, you can prepare the application yourself; if you're worried, use a reputable visa service.