Glycogen phosphorylase (GP) is a validated pharmaceutical target for the development of antihyperglycaemic agents. Phytogenic polyphenols, mainly flavonoids and pentacyclic triterpenes, have been found to be potent inhibitors of GP. These compounds have both pharmaceutical and nutraceutical potential for glycemic control in diabetes type 2. This review focuses mainly on the most successful (potent) of these compounds discovered to date. The protein-ligand interactions that form the structural basis of their potencies are discussed, highlighting the potential for exploitation of their scaffolds in the future design of new GP inhibitors.