It depends what they mean by "inflation".

Presumably they mean rising prices, which only occur if the borrowing goes towards unproductive ventures: i.e. the increase in goods and services is more than offset by the increase in money.