Addition of Syntax Feature for IBM NLU - to enable Lemmatisation

[gaillimhabu]

Is your enhancement related to a problem? Please describe.

Hi Guys ,

great product , thank you for your hard work on this. My main reason for install/testing was to see if NLU could achieve "Lemmatizaion" , I was thinking Hike/Hiking ..

I tested the Syntax feature , which enables you to get your Lemmatization tags back and I would imagine , it could be ( famous last words ) a straight forward feature addition ( like entities , categories etc )

https://developer.ibm.com/articles/a-deeper-look-at-the-syntax-api-feature-within-watson-nlu/

My Example using the demo in the article above , pointed at a link which mentioned hiking but not the word "hike".

Return snippet

{ "text": "considered", "part_of_speech": "VERB", "location": [ 8, 18 ], "lemma": "consider" }, { "text": "hiking", "part_of_speech": "VERB", "location": [ 19, 25 ], "lemma": "hike" },

Thanks in advance !

Designs

No response

Describe alternatives you've considered

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[jeffpaul]

@gaillimhabu what's the use case you would see this help with on your site?

[gaillimhabu]

Hi Jeffrey , Thanks for your message. I'm testing the plugin for content classification but missing link is synonyms for words or conversion of hike/hiking , walking/walk etc. I think with the other features that are in situ , the syntax feature gives lemmatization and the extra edge to the plugin. I'm using Relevanssi search to index and Classifai really enhances that search. Cheers Stephen

…

________________________________ From: Jeffrey Paul ***@***.***> Sent: Tuesday, February 22, 2022 3:29:54 AM To: 10up/classifai ***@***.***> Cc: Stephen Griffin ***@***.***>; Mention ***@***.***> Subject: Re: [10up/classifai] Addition of Syntax Feature for IBM NLU - to enable Lemmatisation (Issue #326) @gaillimhabu<https://github.com/gaillimhabu> what's the use case you would see this help with on your site? — Reply to this email directly, view it on GitHub<#326 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AXY66OQ4MFXL2P5FHHAUQ6TU4L7LFANCNFSM5OOV7Z7A>. Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[jeffpaul]

@gaillimhabu are you looking for ClassifAI to add those synonyms that are returned as part of the taxonomies from the plugin settings?

[gaillimhabu]

Hi Jeffrey , Yes , similar to how the behaviour is currently. The syntax call for lemmatisation includes the word class type and so perhaps it could be VERB only. The call I used can return the other features and so I assumed that's how Classifai achieved also. I'm not an expert in the field, but lemma is what I'm after , alternatively I will need to come up with synonym map lists walk=walking for example. Thanks again Stephen

…

________________________________ From: Jeffrey Paul ***@***.***> Sent: Wednesday, February 23, 2022 4:42:09 AM To: 10up/classifai ***@***.***> Cc: Stephen Griffin ***@***.***>; Mention ***@***.***> Subject: Re: [10up/classifai] Addition of Syntax Feature for IBM NLU - to enable Lemmatisation (Issue #326) @gaillimhabu<https://github.com/gaillimhabu> are you looking for ClassifAI to add those synonyms that are returned as part of the taxonomies from the plugin settings? — Reply to this email directly, view it on GitHub<#326 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AXY66OSZHFVXY5M7S5C3JELU4RQSDANCNFSM5OOV7Z7A>. Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. You are receiving this because you were mentioned.Message ID: ***@***.***>