Hi @ajeemaw,
Clientlibs organizing is clearly documented in WKND chapter 3 - https://helpx.adobe.com/au/experience-manager/kt/sites/using/getting-started-wknd-tutorial-develop/p...
It has component specific ".less" files and a common variables file named variables.less -> Individual clientlibs folder are included to clientlib-site/base via embed property which is then included in headerlibs as a single clientlibs category.
Could you please elaborate your point mentioned as "Note". You mean to load component specific clientlibs and not as complete clientlib category? If possible, share your existing clientlibs skeleton and the way you want to include the same.