The building was originally the residence of the Castaldo family, administrators of the Cantelmo family. In 1770 it was completely renovated by the new owner, Filippo De Stephanis, as the inscription on the central window testifies.