After the upgrade from AEM6.1 to AEM6.4, the issue happened.
The editToolbar can only appear after editing the component from left sidePanel.
sling:resourceSuperType | foundation/components/parbase |

The component outside of the parsys (The resource type isn't parbase) can be edit:

For the newly created page, we cannot edit it because there is no component is dragged/added.

<cq:include script="/libs/wcm/core/components/init/init.jsp"/> was written in the head.jsp