It depends on the startup, but there are opportunities at Japanese and non-Japanese owned startups alike, for people without Japanese skills.
If you have someone who can help you through the paperwork, creating a company isn't so hard. It took us about 60,000 yen and one month to create at Godo-Gaisha (similar to a LLC).