is part of the image store features, but it needs to be activated. Go to settings > general > widget.
Once activated the widget has a few option one of them is “Filmstrip mode” check it to display the gallery just like in the sidebar. You may have to adjust a few styles depending on your theme.
The Filmstrip mode is dynamic and it will the page count base on the size of the thumbnails and sidebar width.