⚓ T254523 Lint wikitext against Parsoid and legacy parser wikitext metrics

Lint wikitext against Parsoid and legacy parser wikitext metrics
Open, MediumPublic
Actions

Assigned To

None

Authored By

	cscott
	Jun 4 2020, 8:55 PM

Description

Once we set appropriate wikitext limits for Parsoid (T254522), we will need to lint all WMF content against these limits and flag pages for fixup (splitting? simplification?) which the legacy parser would parse but while fail Parsoid's resource limits.

Alternatively we could ensure Parsoid can handle a strict superset of all content accepted by the legacy parser... but that's probably not realistic.

Details

	Subject	Repo	Branch	Lines +/-
	ParsoidFragmentMode: use special 'exttag' strip marker	mediawiki/core	master	+45 -5

Customize query in gerrit

Related Objects
Search...

Status	Subtype	Assigned	Task
Open	Release	None	T84936 Release VisualEditor-MediaWiki as "1.0"
Open		None	T50429 [Epic] Support editing parts of a page in VisualEditor-MediaWiki
Open		None	T54365 Explore performance gains from progressive (JIT?) de-alienation in VisualEditor
Open		None	T174303 Copy-pasting linked ISBN numbers from view mode HTML into VisualEditor inserts wikitext links to Special:BookSources (it should turn them into magic links?)
Open	Feature	None	T54091 The read HTML should have hinting to allow full DOM copying (as opposed to just rich copying) from read mode into VE surfaces
Open		None	T55784 [EPIC] Use Parsoid HTML for all page views
Open		None	T258836 [EPIC] Ensure Parsoid meets performance criteria for serving read views on the Parsoid cluster
Open		None	T254508 Reconcile Parsoid memory usage w/ legacy parser and mediawiki core
Open		None	T254523 Lint wikitext against Parsoid and legacy parser wikitext metrics
Open		None	T254522 Set appropriate wikitext limits for Parsoid to ensure it doesn't OOM
Open		None	T254521 Collect data and correlate Parsoid memory usage with legacy parser memory usage
Open	BUG REPORT	None	T286355 Templates expanding to mapframe extensions with large bodies exceed wikitext limits