New York is a one-party consent state—you can legally record a conversation if you are part of it.
However, recording someone else’s conversation without consent is Eavesdropping, a Class E Felony under Penal Law §250.05, punishable by up to 4 years in prison.
Always ensure at least one party to the call (you) consents before hitting “record.”