Added HTML parsing for content from Threatmatch

[pietrocapece]

Proposed changes

• Added a function that parses the content being fetched from Threatmatch and removes any HTML tags

Related issues

• None

Checklist

• I consider the submitted work as finished
• I tested the code for its functionality using different use cases
• I added/update the relevant documentation (either on github or on notion)
• Where necessary I refactored code to improve the overall quality

Further comments

[flavienSindou]

I have reviewed and tested part of this implementation, and it works well overall.

I left a few suggestions that I believe would help make the code simpler.

Thank you for adding information and error logs.

The connector still follows an old template of the connector implementation. New features, such as pycti.OpenCTIConnectorHelper.helper.schedule_iso, could help you manage the connector's scheduled runs, for instance.

[flavienSindou]

I think this is not necessary as you could use popular BeatifulSoup library later in the code to remove all tags

Suggested change

	def remove_html_tags(self, text):
	class HTMLTagRemover(HTMLParser):
	def __init__(self):
	super().__init__()
	self.fed = []
	def handle_data(self, data):
	self.fed.append(data)
	def get_data(self):
	return "".join(self.fed)
	parser = HTMLTagRemover()
	parser.feed(text)
	return parser.get_data()

object["description"] =  bs4.BeautifulSoup(object["description"], "html.parser")..get_text()

[helene-nguyen]

@pietrocapece Thank you for your contribution. Could you resolve the conflicts ?