"Unless" generally introduces the necessary condition, whereas the other part of the conditional statement must be negated to become sufficient condition.
X unless Y is properly diagrammed as:
~Y >X
If NOT Y, THEN X
or
~X > Y
IF NOT X THEN Y
These are logically equivalent statements.
Therefore,
It would be very hard for a man to live with me unless he is terribly strong" is properly diagrammed as: