The high line, under Klopp as well, was always a high risk high reward thing. The high press would often help us allow the whole team to remain compact when pressing, giving us lots of counter pressing opportunities + resulting attacking phases. At the same time, the odd time a team successfully puts some quick passes together or lumps the ball behind our last defenders, we'd look really vulnerable.
But the former shaped our team for the last decade and gave us one of the best defensive records in the league for many seasons. It's just that we look really shit on the occasions where we are exposed.
The defence can go deeper but that would mean our counter pressing becomes less effective. Double-edged sword.