Bit hard to interpret given how ruined it has gotten and from looking up from the bottom of the earthworks.
This particular satellite image gives a better idea. Looks like you had rectangular keep at the southeast corner connected to a rectangular curtain wall with a tower/hall with a peaked roof at the nw. Maybe a separate great hall?