The Shakers looked on course for a comfortable win after a superb first half which saw Andy Bishop and skipper Paul Scott put them 2-0 inside half-an-hour.
Bishop struck his sixth goal of the season in the 57th minute before Bury surrendered their 3-0 lead in 10 minutes of madness.
Sub Rob Elvins pulled one back, Scott's handball allowed Scott Davies to score a 77th-minute penalty and two minutes later, Danny Hylton broke to seal a share of the spoils and maintain the hosts' unbeaten home record.
"It feels like a loss," said Knill. "We were 3-0 up and really comfortable, then a lapse in concentration let them back in it and we made some mistakes for their goals.
"We knew that if they got a goal, they would get some momentum and the crowd would be lifted, and sadly that's what happened.
"When you're leading 3-0 anywhere you think it's game over. We played really well, and the first goal was one of the best you will see anywhere.
"It's disappointing, but we are nine unbeaten and there are 20-odd other teams that want to be where we are. Lots of teams will come here and take nothing."
BURY: Brown 7; Scott 6, Futcher 7, Sodje 6, Buchanan 6; Bennett 7, Dawson 7, Barry-Murphy 7, Jones 7 (Baker 83); Bishop 8, Morrell 8 (Hurst 88). Subs: Cresswell, Racchi, Belford.
Tweet
