The Australia-born 23-year-old was the only uncapped player included in the 23-man squad named on Monday, which is lacking captain Chris Wood and defenders Michael Boxall and Liberato Cacace among a number of injured players.
"I want to congratulate Lachlan Bayliss on his debut All Whites call-up," Bazeley said in a New Zealand Football statement.
"He has been in great form over the last few months with Newcastle Jets, so I'm pleased to bring him in for the first time at senior level."
Bayliss, who was part of New Zealand's Olympic squad at the Paris Games, has scored five goals for the A-League leaders Newcastle.
New Zealand meet Finland at Auckland's Eden Park on March 27 and Chile three days later at the same venue.
Bazeley's All Whites are pooled with Belgium, Egypt and Iran in Group G for the June 11-July 19 World Cup in the United States, Canada and Mexico.