He takes his side to Bradford City looking for a first league win since the start of November.
And following Tuesday night's 3-2 home defeat by Stockport County, Shakers could slip into the League Two relegation places if results go against them.
Knill, who took over at Gigg lane on Monday, needs no reminding there has to be an immediate upturn in results if his side are to avoid the worst possible end to the season.
"Losing at home to Stockport wasn't quite the start I wanted, but we did start the game brightly," said Knill.
"There were some positives, but the bottom line is about winning at all costs.
"It's up to me to change that and to change certain mentalities and attitudes And we have to do it quickly.
Change
"We have to hit the ground running. There are lots of things that need changing."
Knill believes Stockport are a side Bury should be trying to emulate.
"I've seen Bury play maybe five or six times already this season," he added.
"There are some good young players here and some good experience.
"On Tuesday we saw an example in Stockport of a successful team in this league.
"They have good athleticism, they are strong and powerful and that is what you need in this league. I want to pass the ball and in the right areas.
"It's a pretty basic game and you ask people to do the basic things. Hopefully you then have the quality in the final bit to open up people."
Bradford City have started to climb the table and are unbeaten so far this year.
Knill is interested in a loan deal with Blackpool over winger Simon Wiles and full back Paul Tierney who have been made available by the Seasiders.
Key opponent: Barry Conlon - Experienced striker still capable of popping up with a goal
Prediction: Bradford 1 Bury 1 - Knill should earn his first point
Agree with the prediction? Have your say.
You can get 10/1 on Bury winning 1-0 with Betfred. For this and more odds, click here.
Tweet
