Many evil beings have attempted to steal the Book of Shadows.
A trio of shapeshifters posing as the Charmed Ones' neighbors tried to get the book by one of them posing as a postman. Although they could touch the book (representative of how the Charmed Ones weren't quite strong enough for its protection to be at full power yet), they couldn't get it out the front door.
This demon managed to capture it by bringing it to the Astral Plane. This was possible as, technically, the book was still in the house (or rather the area where the house would be on the Astral Plane) but just on another plane. Due to his telekinetic powers, he could easily flick through the pages and move the book without it hurting or repelling him. By reading the spells in the book backwards, he almost rebound the Charmed Ones' powers, but they were able to retrieve it just in time.
The human half of Belthazor tried to get the book, however, by then it was strong enough that no evil could touch it. As a result, it jumped off its stand and avoided him everytime he took a step forward. He later mentioned that he got shocked the last time he tried to touch it.
A dark priestess named Dantalian worked with a warlock named Zile to capture Prue and unite them in a dark wedding ceremony which turned Prue into a warlock. By this time, the sisters' magic was so intertwined that the evil bond turned Piper and Phoebe into warlocks, and the influence contaminated the Book as well. Since the Book was now evil, Dantalian was able to steal it and take its power into her own hands—thus becoming the first evil being to physically get the Book out of the manor. By vanquishing the warlock, the evil bond broke and the sisters and the book returned to normal. 
In the alternate timeline of the warlock Bacarra who time traveled back a few months with knowledge from the future to help his past-self. He told him of a potion to blanket himself in goodness long enough to get through the Book's defenses, which contained, among other ingredients, Piper's blood. This allowed him to steal the book, which even he noted contained information on and vanquishing potions for nearly every demon he'd ever heard of. Fortunately, Piper traveled back to stop him by stopping the entire series of events from happening, and Bacarra never got the book. 
Three evil low-level witches, the Stillman Sisters, cast an identity theft spell to make the world see them as the Charmed Ones. The book saw the Stillmans as the Charmed Ones as well; it wouldn't even let the real sisters touch it. The Stillmans then broke into the Manor and used a spell in the Book to steal the sisters' powers. However, the real sisters were able to convince their Whitelighter, Chris Halliwell, that they were the real Charmed Ones. He tricked the Stillmans into fighting with each other and severing their bond as sisters, which undid the identity theft spell. The real sisters then took back their powers, bound the Stillmans' and turned them over to the authorities. 
The demon Zankou was able to steal the Book by killing friends of the sisters and resurrecting innocents that they've lost, to make them feel weak and vulnerable. Whilst all three of them being mentally weakened, the Book's defenses were weakened as well and Zankou used the opportunity to take it. Though he managed to take it into his hands, he needed the sisters' powers to access its magic. Since the sisters lost their confidence, the Book defended itself against them instead. Eventually they managed to get it back with a Power of Three spell.