Is New Year's Day a federal holiday?

Yes. January 1 is a US federal holiday. When it falls on a Saturday, the federal observance shifts to the previous Friday; on a Sunday, to the following Monday. See the full schedule at US holidays.