Ole Colonial Hostel or what

This old colonial ruin is on Franklintown Road just off the colonial Winan's estate grounds in Baltimore. It's in the old town area and try as I may I cannot find out what it was before!

I shant give up!