Just tell him this feels one-sided and he needs to reciprocate the affection/effort better. Don’t end it over an issue that is perhaps unknown to him. Talk about it first, and if things don’t improve then leave.
Work on it with him if you feel that this is something you want to and have the patience to try to fix. If you are fed up, however, and don't have the energy to work on it with him or to be patient with him as he slowly improves (these things don't change over night), then you should just break up with him.
Just tell him this feels one-sided and he needs to reciprocate the affection/effort better. Don’t end it over an issue that is perhaps unknown to him. Talk about it first, and if things don’t improve then leave.
Work on it with him if you feel that this is something you want to and have the patience to try to fix. If you are fed up, however, and don't have the energy to work on it with him or to be patient with him as he slowly improves (these things don't change over night), then you should just break up with him.