Despite much recent theoretical and observational progress in our knowledge of the early universe, many fundamental questions remain only partially answered. Here, we review the latest achievements and persisting problems in the understanding of first cosmic structure formation.