Definition: a legal term. It is ordinary English, describing problems that are complicated, tangled, and difficult to resolve.
In a family law context it might describe the valuation of a private company, the treatment of pre-marital wealth mingled over a long marriage, or a relocation application involving competing family bases abroad. Nothing turns on the phrase itself.
Related Questions:
Is “knotty issues” a legal term? No. Knotty issues is a colloquial description of complex problems, with no legal meaning.
What are the genuinely knotty issues in a family case? Business valuation, identifying non-matrimonial property, apportioning pensions, assessing earning capacity, and international relocation.
Do knotty issues make a case more expensive? Generally yes, because they usually require expert evidence and a contested final hearing.