Repository navigation
Replace separable class hypotheses with PointwiseSeparable - #78
Merged
Merged
Conversation
Uncountable-class uniform-deviation and ERM theorems assumed `[TopologicalSpace H] [SeparableSpace H] [FirstCountableTopology H]` and per-input continuity only to reduce suprema to `denseSeq H`. They now take a single topology-free hypothesis `PointwiseSeparable F`: a countable subfamily approximates the class pointwise along one subsequence for all inputs (van der Vaart-Wellner's pointwise measurable class). - Add `LearningTheory/Rademacher/PointwiseSeparable.lean`: the definition, the reductions of empirical Rademacher complexity, Rademacher complexity and uniform deviation to the subfamily (dominated convergence along a sequence), the bridge `PointwiseSeparable.of_continuous` for separable Frechet-Urysohn parameter spaces, and stability under continuous losses. - Rename every `*_separable*` theorem in UniformDeviation/Bounds, UniformDeviation/Confidence, Rademacher/Dudley and EmpiricalRiskMinimization/Generalization to `*_pointwiseSeparable*`, and delete the topological versions and the `denseSeq` reduction lemmas. - Migrate L1, L2, LipschitzParameter and both KernelPredictor modules through `PointwiseSeparable.of_continuous`. - Add `FunctionClass/Threshold.lean`: threshold classifiers, which are discontinuous in the parameter, are pointwise separable; this gives a confidence bound on the Kolmogorov-Smirnov distance. - Remove `denseRestriction` lemmas left unused in Topology/SeparableSpace/Supremum. Closes #77. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #77.
Uncountable-class uniform-deviation and ERM theorems assumed
[TopologicalSpace H] [SeparableSpace H] [FirstCountableTopology H]plus∀ x, Continuous fun h ↦ F h x, only to reduce⨆ hto a supremum overdenseSeq H.They now take one topology-free hypothesis:
Changes
LearningTheory/Rademacher/PointwiseSeparable.leanempiricalRademacherComplexity_eq_comp_of_tendsto,rademacherComplexity_eq_comp_of_tendstoanduniformDeviation_eq_comp_of_tendsto, whichreduce each quantity to
F ∘ g. The population term uses dominated convergence along asequence, so
Hneeds no topology;PointwiseSeparable.of_continuous, for[SeparableSpace H] [FrechetUrysohnSpace H]plus continuity. FirstCountable implies Fréchet–Urysohn by instance;PointwiseSeparable.compandPointwiseSeparable.supervisedLossClass, stability under acontinuous loss.
*_separable*theorem inUniformDeviation/Bounds,UniformDeviation/Confidence,Rademacher/DudleyandEmpiricalRiskMinimization/Generalizationis now*_pointwiseSeparable*. Each takeshF_ps : PointwiseSeparable Fin place of the three instances andhF_cont, and is proved byapplying the existing countable theorem to
F ∘ g.supervised_approxERM_excessRisk_tail_bound_of_empirical_complexitynow takesPointwiseSeparable Fand continuity of the loss.*_eq/*_denseRestrictionreduction lemmas inBounds.lean, anddenseRestriction_apply,measurable_denseRestriction_applyandabs_denseRestriction_leinTopology/SeparableSpace/Supremum.lean, which became unused.denseRestrictionand theseparableSpace*lemmas stay, becauseProbability/Process/Dudleyand the Gaussian comparison files use them.
LinearPredictor/L1,LinearPredictor/L2,LipschitzParameterand bothKernelPredictormodules keep their concrete hypotheses and go throughPointwiseSeparable.of_continuous. The RKHS ERM parameter space now needs[FrechetUrysohnSpace G]instead of[FirstCountableTopology G].FunctionClass/Threshold.lean. Threshold classifiersx ↦ 1[x ≤ t]arediscontinuous in
t, so the old route could not handle them. They are pointwise separable(rationals decreasing to
t), which gives a confidence bound on the Kolmogorov–Smirnovdistance from a fixed-sample Rademacher bound.
FILE_TREE.mdand docstrings updated.Breaking change
The
*_separable*names are gone. A caller with a continuously parametrized class replaceshF_contbyPointwiseSeparable.of_continuous hF_contand uses the*_pointwiseSeparable*name.
Verification
LEAN_NUM_THREADS=$(sysctl -n hw.ncpu) lake build: 9070 jobs, no errors, warnings or infos.#print axiomson the main new theorems gives onlypropext,Classical.choice,Quot.sound.sorry,admitornative_decide.🤖 Generated with Claude Code