From Diablo Wiki
Chatty Gem You feel like talking to someone.
 Gibbering Gemstone
This item is by FAR the hardest to obtain out of the five items. It can be found the the Caverns of Frost in The Fields of Slaughter located in Act III. Within the Fields of Slaughter there is a cave that can spawn in one of five locations (detailed in the maps below).
If you are trying to farm for the item then it's easiest to select the Siegerbreaker (Start Quest) quest from the Quest Selection screen. This will give you The Bridge of Korsikk Waypoint which is always at the very bottom of the Fields of Slaughter.
Once you have located the Caverns of Frost, head to level 2 and find the Superunique Lacuni, Chiltara. He has a chance to drop the Gibbering Gemstone. There is no guarantee that he will spawn but when he does he will drop the Gibbering Gemstone.
The Gemstone is Account Bound so it can not be traded for.
 Other Reagents
Players must assemble the five ingredients and the Staff of Herding plan to enter the level.
- Black Mushroom ( )-- Found rarely in a room on Cathedral level one, in early Act One.
- Leoric's Shinbone ( )-- Found rarely in the fireplace in Leoric's Manor, in late Act One.
- To farm for this select Quest number 9 "The Imprisoned Angel" in the Change Quest menu when you log in. Take the Waypoint to Leoric's Manor. You will have two rooms to fight from the back of the manor to reach the room with the fireplace in.
- Wirt's Bell ( )-- An Act II vendor (Squirt)sells it for 100,000 gold on her Potions and Dyes tab.
- Liquid Rainbow ( )-- Spawns in the Mysterious Cave in the Mysterious Chest in the Oasis, Act 2. Save Zaven the Alchemist and he will open the entrance to the cave. The chest is located on level one.
- Plan: Staff of Herding ( )-- To teach the recipe to Haedrig. Drops randomly from Izual, Act 4.
Map of Fields of Slaughter
|Items of Diablo III  Item Basics Normal Items Legendary Armor I Legendary Armor II Legendary Weapons 1h Legendary Weapons 2h Item Sets|
|Item Basics||Item Modifiers||Inventory||Artisans||Merchants||Miscellaneous |
|Armor - Class-Specific||Weapons - Class-Specific||Crafting Items||Other Items |
|| • Blacksmith Plans
|Waist||Wrists & Hands||Legs & Feet||Head |
|| Voodoo Masks - WD|
| Chest Armor
|| Amulets cont.
|| Rings cont.
40) Puzzle Ring
|| Sources - Wiz|
|| Fist Weapons - Monk
|| Mighty Weapons - Barb|
|| Daibos - Monk
|| Bows |
|Item Sets |