I dont see any pagination guides on the vaadin documentation? How can I paginate my grid with lots of data(rows).

Did you check this Grid | Components | Vaadin Docs

Grid has virtual scrolling. It loads only the fraction of the data at the time. Based on scroll bar position the Query objects parameters change.

I actually need the pages in the bottom part of the grid. For example I want to see 10 rows and data on the first page, and the rest on second page and so forth.

You can use this addon: Grid Pagination - Vaadin Add-on Directory