Yeah, without going into spoiler territory, Little Garden (and the introduction of the giants, specifically) is one of those things that causes plot holes later in the series if you cut it, like 4kids turning Laboon into an iceberg.
Also, this is just me, but Little Garden has one of my favourite Zoro comedy scenes, and I want to see it adapted.
EDIT: Also, I know I'm in the minority on this one, but Skypeia is my personal favourite arc, and I really don't want them to cut it.
-they had Nami introduce the story of Montblanc Noland, so they've already planted the seeds for Skypeia.
-It introduces the Dials, which become important to Nami and Usopp's movesets later.
-It's the first arc with Robin as part of the crew, and the events of Water 7 aren't as impactful without that arc establishing her place in the cast.
-Enel is my favourite villain, and he has one of the best moments in the manga (I know it's gonna be almost impossible to accurately replicate, but I wanna see how close they can get).
Plus, there are a couple other things that were introduced in Skypeia that haven't paid off yet in the manga, but might become more important later.