The two storey solid wooden building housing the museum today was built in the year 1897 as a fort by the second White Rajah, Charles Brooke to impose peace and order in the region where warfare among the local tribes prevailed.
Located in middle of Beautiful Jade Center, Persiaran Kabor, also known as Old Folks' Street (Lao Ren Jie 老人街) is a roofed area in between shoplots where coffeeshops lay out tables and chairs along where folks congregate there for breakfast or tea, drinks, chatting with one another, and passing their time.