Outside the hut you can find a basket with some Leather Strips, a quiver of Iron Arrows and a Woodcutter's Axe. Under the cliff below the shack there is an Orichalcum Ore Vein. You can find a Diamond sitting on the surface of this vein. There is a Pickaxe nearby this vein. You can also find some Purple Mountain Flowers and a gourd near the wood chopping block nearby the shack. Look on the Wood Chopping Block to find the Diadem of the Savant.
Inside the shack you can find a Steel Battleaxe to the left. There is also a Tanning Rack on that side as well next to a large set of shelves. On those shelves you will find a Woodcutter's Axe, Eye of a Sabre Cat, Pine Thrush Egg, some dishes, the Archery Book - Vernaccus and Boulor, a bit of Nirnroot and an Orange Dartwing.
Further south in the mountains from the Shack you can find a Shrine to Talos. If you head there you will find Steel Cuffed Boots, Imperial Light Shield, Heavy Imperial Helmet, Imperial Sword, the Two-Handed Weapon skill book: King, a copy of The Amulet of Kings, a satchel, some loose coins, a coin purse, and some Alto Wine.