Evaluation Metric The evaluation metric for this competition is root mean squared error (RMSE) of the submitted forecasts. Submission Format For every date and time in the test set (i.e., for the 14th of the month to the 19th of the month for both 2011 and 2012, and for every hour of the day), submission files should be CSV files containing two columns (with headers): datetime and count. A sample submission file is provided with the data set.