Hi there,
Yes it is possible, there is an option available when creating the table to include header page in subsequent pages and the option is also available in the Object Palette of the Header Row.
When the Header Row is selected, go in the Pagination tab under Object Palette. There you have a few options available including 4 check boxes on the bottom of the selected tab. "Include Header Row in Subsequent Pages" is the option that you are looking for.

I hope this will help.