I would recommend a shoulder rest as an important accessory, makes playing much more comfortable. And a tuner of course, but you can download an app for it on your cellphone for free. Also download a metronome app, it really helps you with the rhythms. And get a cloth to wipe off the rosin of the strings and the belly of your violin after every practice session.
I saw the cutest mute at shar.com it was a little mouse. Also there are some blingy mutes for those interested. I have tried many mutes and I find the regular rubber 80 cent ones to be the best and most reliable buy a couple in case you loose one.