Hi,
Technically, you could work with both. I haven't tried it myself, but I think one thing you should consider is the duplication of users. What I would explore is the option to sync between SAML and LDAP first. I hope you can share your findings here.
Hope this helps.
Esteban Bustamante