This depends on what you want to achieve. If you are new to Joomla! and have no clue how it all fits together, just install the sample data. If you don't like the English sample data because you - for instance - speak Chinese, then leave it out.