I have the tab s4, but seeing the size and weight of the s5e really made me think that it would be a better fit for me. I ended up preordering it just to see how it compared to the s4. The form factor is amazing. I never used the s pen so that wasn't a loss for me. I also have accepted the headphone jack removal and am fine with using my galaxy buds or a USB c adapter. Having a fingerprint sensor for apps is so much better than the iris scanner in the s4. I tried opening up apps on both tablets at the same time and the s4 was slightly faster, but without a direct comparison, this is not something I feel like would be noticeable in everyday usage. As for gaming, I only tested a few games that are not very demanding and did not had any issues.
It's been said before, but it really comes down to your needs and preferences. If you do not need a headphone Jack, the s pen, or play very resource demanding games, I would totally recommend the s5e. I loved the s4, but it's just so nice holding a thin, light tablet while reading, watching movies, etc. And having call continuity between the s5e and s10+ is also extremely convenient (still no idea why this was not added to the s4 with the pie update and was a big reason I started looking at the s5e)
I am likely going to be selling my s4.