An application, sworn statement, Identification, and fee are required. Q: How do I get a Social Security Number for my baby?Do you swear to the truth of your statements? Complete the marriage certificate application (for a Letter of No Record). In the Marriage Information section, provide your full name and date of birth.