I get your concern, but I don't think it will ever be made easier.
The entire idea behind this dungeon is to shift challenging content away from main quest lines. This will give players the challenging content requested (but in side quests) without discouraging casual players to continue the game's story.
I think the difficulty is fine. The Beastman Fight Club is a missed opportunity. There is really no reason do it because it doesn't drop anything memorable. Please design some cool mounts that only this instance drops.
