It would, mostly, be the citizenship of the baby's parents. A few countries give citizenship to anyone born in their airspace, but not in international airspace over an ocean. There's a bit of an urban legend that the child gets citizenship of the country in which the aeroplane was registered.