Research
Research article

Continual learning on personal devices

How a shared model becomes each person’s own through local weight updates.

Human knowledge has never lived in one place. It grew in many hands, in different crafts, languages, and ways of judging what matters, and it advanced when those differences met. Foundation models bring the same capabilities into lives that have little in common. Memory helps these systems carry a person’s history across conversations. We want that history to shape the development of the model itself, so that copies of a shared foundation can follow different paths of learning.

In The Second History of Intelligence we wrote that a technology’s second history is decided by how many people can exercise its power, how many purposes it serves, and what kind of civilization grows around it. As intelligence enters different lives, its distribution can become its diversification, and the differences should belong to the people who formed them. That needs a model that can change for one person without changing for everyone. We test the most direct form of it in this article. Each person’s copy of the model learns from their own use, on their own device, and the result stays under their control.

A person can explain what an assistant missed in a few words. Someone with a sick child at home and a meeting later that day does not want a checklist, and says so. “Help me decide what needs my attention first” asks for a different way of approaching a problem. The correction says what kind of help this person wants in that situation. Someone else in the same situation might want the list. A model that learns from the correction has to carry the behavior into the next unfamiliar situation, with different facts, and still produce the full comparison when this person asks for one. That means learning when a behavior is useful as well as how to produce it. It also means that two copies of the same model begin to differ.

We study this form of learning in PLM 1.8B and 3B. Starting from explicit feedback, we construct supervised examples that preserve both the lesson and its conditions of use, and we train a persistent LoRA adapter on these examples, replay of earlier lessons, and general-capability anchors. The base weights stay frozen, and the adapter stays the same size through successive updates, so what a person teaches accumulates in a small adapter, under half a percent of the model’s parameters, that belongs to their copy of the model. The research question is whether this small amount of trainable state can accumulate useful behavior within the compute budget of a personal device.

Across eight controlled feedback profiles and 30 update windows, three results answer it.

  • Feedback changes behavior beyond the original correction. Held-out task pass rates rise from 75.7% to 96.0% for PLM 1.8B and from 84.7% to 97.7% for PLM 3B, and weight updates retain an advantage when the frozen and adapted models receive identical feedback prompts.
  • Learning when a behavior applies improves transfer. Repeated training on valid corrections establishes a strong baseline. Condition-preserving and boundary examples add gains when the situation changes or a current request overrides a learned default.
  • Supervised targets make effective use of local compute. In a separate development comparison on the tested Mac configurations, conditional SFT reaches higher task pass rates than SDFT within a 30-minute update budget.

These personal-behavior gains come with measurable declines on the general-capability evaluations.

The complete loop runs on personal computers. Our standard update takes a median of 12.8–22.2 minutes across the tested Mac and Windows configurations, including data construction, training, validation, and export, and the exported adapter remains useful on a phone. Learning can happen between periods of use, with the result available in later conversations and no hosted training service in the path. Each feedback profile shapes its own adapter from a shared starting model, which is where that diversification begins.

Personal-behavior rubric gain over the frozen model after 30 windows, for PLM 1.8B and PLM 3B on one scale. Three separately trained adapters: corrections as recorded gain 3.79 and 2.68 points; the same corrections repeated to the matched budget gain 7.53 and 4.61, which is 3.74 and 1.93 more; corrections with their conditions of use gain 8.78 and 5.28, a further 1.25 and 0.68. With the identical feedback prompt, the frozen model gains 1.28 and 0.80 and the conditional adapter 8.98 and 5.40, a difference of 7.70 and 4.60. Below, the ten-suite general-capability macro average changes by −1.93 and −1.76 percentage points; the one-sided 95% lower bounds, −2.34 and −2.15, extend past the −2-point noninferiority margin.

Figure 01. Where the gain comes from. Personal-behavior rubric gain over the frozen model on 240 held-out questions per profile after 30 windows, for three separately trained configurations, with the same-prompt contrast and the change on ten general-capability suites. Eight profiles and three seeds per model; error bars are 95% profile-bootstrap intervals, and differences are computed before rounding. The general-capability point is the equally weighted macro change, drawn with its one-sided 95% lower bound against the predefined −2-point noninferiority margin; the two scales are separate.

Figure 1 shows what the final gain is made of. Figure 2 shows how it accumulated, on the fixed 48-question probe after every one of the 30 windows, including windows in which a candidate was rejected.

Two panels, PLM 1.8B and PLM 3B, share a rubric-score axis from 89 to 100 over 30 update windows on a fixed 48-question probe set. In both, the frozen model stays flat, the feedback prompt rises a little and stays level, and both LoRA adaptations climb steadily, with conditional-data LoRA-SFT ending highest: 98.6 against 90.8 frozen for 1.8B, and 99.3 against 94.6 for 3B. A strip under each panel marks the feedback stream: no new social-opening feedback in windows 11 to 20, a lasting change to detailed answers at window 17, and one-off requests for brief answers in windows 24 to 26.

Figure 02. Learning through successive updates. Mean personal-behavior rubric score across 30 update windows on a fixed 48-question probe set; the task pass rates in the text use the full 240 held-out questions per profile. Curves follow the active adapter, including windows in which a candidate is rejected. Each model uses eight profiles; three training seeds are averaged within profiles before computing the mean and 95% profile-bootstrap interval. The strip marks the scheduled gap in social-opening feedback, the lasting change in response-detail preference, and later task-specific overrides.

Turning feedback into training data

A correction identifies something the current response got wrong. Converting it into training data requires deciding what should change in future responses. “Give me less detail” could describe a lasting preference, a request for this exchange, or a reaction to an answer that missed the decision entirely. Applying the same short-answer target to all three would teach the model to be brief without teaching it to be helpful.

The lesson in the opening example is to identify the constraint that determines the next action when attention is limited. The child’s illness and the time of the meeting belong to the episode. They should not become facts in the model’s weights, because the next situation will have different facts and the same shortage of attention.

Our data constructor separates these two kinds of information. It uses a frozen PLM with validation rules and receives the available conversation, the explicit feedback, and any supported resolution, meaning an answer the person endorsed later in the exchange. The constructor proposes at most four candidate examples from each eligible event. At most one directly repairs the original answer. Additional candidates change the situation while preserving the behavior the feedback supports. Where the source permits it, a boundary example changes the relevant condition so the same behavior should no longer apply. A model that has learned to focus on one immediate step should still provide a detailed comparison when explicitly asked. Validation rejects what the exchange does not support, such as a diagnosis, a medicine, or a lasting rule the feedback never stated.

The condition has to be visible in the example. Construction metadata records when a behavior applies; the training input must make that condition observable. If a target depends on the person being short of time, the input must establish that constraint. If it depends on information that nobody has supplied, the target must ask for it or leave the decision unresolved. The same rule decides between the readings of “Give me less detail”, since the exchange has to support whichever one is chosen. We defer negative feedback that does not support a usable target. Silence and the model’s confidence do not provide supervision.

We distinguish training targets before and after a correction. A repaired answer may use a correction the person has already given. An example teaching the model to answer correctly before that correction must use only the information available at the original response. Otherwise, training quietly gives the learner knowledge it will not have at inference time. We preserve separate causal cuts for these two targets and mask the user’s messages, previous mistakes, and tool observations out of the loss. They can supply context; only the assistant target accepted by validation contributes to the loss.

Figure 03. Preserve the lesson as the situation changes. A feedback event can support a repaired answer, a new situation with the same behavioral requirement, and a contrasting example where that behavior should change. Every target must be supported by information visible at its response point, and only the accepted reply supplies the training loss. These are training examples; held-out transfer responses appear in Figure 07.

The feedback streams in this study are controlled. We wrote the source situations and the feedback in advance, so both model sizes receive identical events and every method is compared on the same stream. Our experiments with real conversations are outside the scope of this article and will be reported separately. Each profile is one such stream with its own behavioral requirements, known before training. The final study contains 3,840 source events, of which 3,247 are eligible for supervision; a separate set of 960 events supports method development. We split source situations before constructing variants, so all variants of an episode fall on the same side of the split. Candidate validation checks source support, time ordering, factual consistency, applicability, and duplication before materializing a training schedule. The constructor is held fixed throughout the study.

We tested the construction choices on the development set, with six profiles, ten update windows, and three seeds.

Scroll to compare all columns

Training materialPLM 1.8BPLM 3B
Repaired answers as recorded, repeated to the matched exposure+4.13+2.82
Clean supervised targets+5.19+3.58
Clean targets with condition-preserving and boundary examples+5.79+4.10

These are development comparisons after ten windows, at matched exposure. The final study in Figure 1 runs 30 windows on separate profiles, so its gains are larger, and its first bar uses each correction once per epoch, before repetition. Most of the additional gain over the raw-response baseline comes from rewriting the exchanges into clean targets. The condition-preserving and boundary examples add less here, and the transfer and opposite-condition tests later in the article are where that addition shows.

Updating a compact model

Each round of feedback needs to improve the model that is already in use. We use supervised fine-tuning to learn from the constructed targets and LoRA to limit trainable state.1 Each adapted linear layer combines its frozen base weight with a learned low-rank update.

Weffective=W0+αrBAW_{\mathrm{effective}} = W_0 + \frac{\alpha}{r}BA

The matrices A and B are trained; the base weight W₀ is fixed. Each profile has one continuing adapter. A new window starts from the last accepted adapter and updates those same matrices, so the number of adapter parameters stays constant as feedback accumulates. The update protocol stays fixed across the stream.

Each update combines new supervision, replay of earlier valid examples, and general-capability anchors. Replay revisits behaviors learned in previous windows. Anchors supply broad examples of instruction following, reasoning, and other base-model behavior, preventing every training batch from pointing toward the latest personal correction. These are training materials kept separate from the evaluation sets. We draw replay from a bounded, skill-stratified reservoir and remove targets whose underlying preference has been superseded.

The loss is cross-entropy on accepted assistant tokens. We average over target tokens within each example, then over examples in the materialized schedule. This prevents a long corrected answer from receiving more weight simply because it contains more tokens. The standard workload, which we also use for the timing and memory measurements, contains 64 new-example exposures, 16 replay exposures, and 16 anchor exposures per epoch. At two epochs and an effective batch size of eight, it takes 24 optimizer steps. The longitudinal experiments retain the workload produced by accepted examples in each window, so their step counts vary.

We use AdamW with a learning rate of 5 × 10⁻⁵ for the standard workload, a short warm-up, and cosine decay. Optimizer moments reset between windows while the learned adapter persists. A paused update preserves its optimizer and accumulation state so it can resume correctly.

Before replacing the active adapter, we compare the candidate with the previous version on a separate 96-item activation set. It contains 32 general-capability questions, 24 instruction-and-tool questions, 24 current-behavior and opposite-condition questions, and 16 critical-error checks. Acceptance requires no new critical errors, no decline in the current-behavior slice, at most one fewer pass on the instruction-and-tool slice, and at most two fewer passes overall. This is a local update rule; cumulative retention is measured separately over the full learning stream. The final held-out evaluation is unavailable to training and activation decisions. A rejected candidate leaves the previous version active, and the learning curves include these unchanged versions.

One update window as a loop. Explicit feedback passes a fixed constructor that proposes up to four candidates, and a validation step. Validated examples join valid replay and general anchors in the training mixture, 64, 16 and 16 exposures in the standard workload. LoRA-SFT keeps the base weight W zero frozen and trains only the low-rank matrices A and B; the loss gradient reaches B, and reaches A through B, while W zero receives no update. The candidate adapter meets an independent activation test with 96 items. If accepted it becomes the next active adapter, and the next window continues the same matrices; if rejected, the previous adapter stays active. The final evaluation is separate and never used for activation. Layer strips show the adapted projections: Q, K, V and O in every GQA layer, and the feed-forward gate, up and down projections in the later half of the model, for PLM 1.8B with 20 layers and PLM 3B with 30.

Figure 04. A fixed-size adapter that continues learning. A fixed constructor produces validated supervision, which is mixed with replay and general-capability anchors for LoRA-SFT. Only the adapter matrices are trained. Each candidate is checked on an independent activation set; accepted updates continue the same fixed-size adapter, while rejected candidates leave the previous version active. The strips mark the adapted projections in PLM; parameter counts are derived from the architecture.

The next choice is where to put that trainable capacity. PLM combines ShortConv blocks with grouped-query attention. PLM 1.8B has 20 layers, including five attention layers; PLM 3B has 30 layers, including eight. We adapt the Q, K, V, and output projections of every attention layer, together with the gate, up, and down projections of the feed-forward networks in the latter half of the model. ShortConv kernels, embeddings, normalization parameters, and the output head remain frozen. The reference configuration uses rank 16, scaling α = 32, and adapter dropout of 0.05.

We compare adapter placement and rank on six development profiles over ten windows and three seeds. The comparisons use conditional supervision, with source events, input and target-token passes, and optimizer steps matched across configurations. At rank 16, attention-only adaptation gains 3.53 rubric points over the frozen 1.8B model and 2.50 over 3B. Including the later feed-forward projections raises these gains to 4.54 and 3.24. Adapting every feed-forward layer raises them further to 4.90 and 3.49. The first extension contributes most of the improvement from adapting feed-forward layers.

Increasing rank also improves quality, at an additional resource cost. In the attention-plus-later-FFN layout, moving from rank 16 to 32 adds 0.28 rubric points for 1.8B and 0.19 for 3B while doubling the trainable parameter count. Median completed-update training time on the tested Mac paths rises from 186 to 229 seconds for 1.8B and from 260 to 307 seconds for 3B. These development updates use one epoch and 12 optimizer steps; the complete-update measurements below use a separate two-epoch workload. We use rank 16 with the later-FFN layout as a working balance between improvement and update cost. It trains approximately 7.0 million parameters for 1.8B and 12.0 million for 3B, while the larger configurations retain a measurable quality advantage.

For each model, personal-behavior gain against trainable parameters on a log scale, for five adapter configurations from a one-epoch development study. Placement at rank 16: attention only gains 3.53 for 1.8B and 2.50 for 3B; adding the later feed-forward layers, the selected configuration, gains 4.54 and 3.24; adding all feed-forward layers gains 4.90 and 3.49. Rank in the later-FFN layout: rank 8 gains 4.06 and 2.87, rank 32 gains 4.82 and 3.42. The table below lists parameters, median training time, and median peak memory for the Mac path.

Figure 05. Choosing adapter capacity and placement. Adapter placement and rank change both behavioral improvement and update cost. The two sweeps share the attention-plus-later-FFN, rank-16 configuration. Quality is measured after ten development windows on six profiles and three seeds, with matched source events, token exposure, and optimizer steps; error bars are 95% profile-bootstrap intervals. Each update uses one epoch and 12 optimizer steps. Training time is the median of completed updates; peak-memory statistics include all 180 attempts per configuration and device, including failed attempts. Mac memory measures process physical footprint; Windows memory measures GPU-resident memory.

Generalizing beyond the correction

An updated model should do more useful work with the same information. We test whether its weights carry a lesson into an unfamiliar situation, whether a current request can override the learned behavior, and whether the benefit survives a comparison with supplying the same feedback in the prompt. These tests distinguish learning an adaptable behavior from reproducing a corrected answer.

We evaluate eight skill families covering prioritization under limited attention, adapting plans to stated constraints, responding to difficult experiences, natural social openings, grounded follow-up writing, technical explanation, editing, and respecting the current request. Each of eight profiles has 240 held-out questions. Within every skill family, we test 12 new-wording questions, 10 transfers to a different situation, and 8 opposite-condition questions. We repeat training with three seeds per profile and evaluate complete sets at windows 0, 5, 10, 20, and 30. The fixed 48-question subset tracks every intervening window.

The scoring protocol combines deterministic checks for structured outputs and verifiable facts with method-blinded rubric evaluation of open-ended responses. Models answer at temperature zero, with at most 512 output tokens. Five dimensions score factual grounding, current intent, helpfulness, communication calibration, and transfer or boundary handling from zero to two. Their total is normalized to a 0–100 rubric scale. A task passes at eight out of ten only if current intent receives full credit, factual grounding is nonzero, and no critical error is present. The table reports mean rubric scores; the opening results report task pass rates. Confidence intervals in this section resample profiles after averaging training seeds within each profile; successive windows are observations of the same learning process.

The rubric judge is Claude Opus 5, an external frontier model, run with a fixed prompt and checkpoint. It receives task facts, permitted actions, critical-error definitions, and the response, with model size, training method, and update window hidden. On a 640-pair human-rated subset, two reviewers scored each pair independently and disagreements were adjudicated. The judge’s pairwise preference, counting a win for either response or a tie, matched the final human decision on 88.75% of pairs, 568 of 640.

The main method comparison controls training exposure as well as architecture. Direct-feedback LoRA-SFT and conditional-data LoRA-SFT use the same source events, replay, anchors, optimizer recipe, and evaluation. We match supervised target-token passes, repeating direct examples when necessary. This asks whether changing the supervision helps at a comparable training budget. It also gives a strong simple baseline against which to judge the additional construction work.

Scroll to compare all columns

Method after 30 windowsPLM 1.8BPLM 3B
Frozen model89.5293.82
Frozen model with feedback prompt90.7994.62
Direct-feedback LoRA-SFT97.0498.42
Conditional-data LoRA-SFT98.2999.10
Conditional-data adapter with feedback prompt98.4999.22

We also test a cheaper, natural-volume direct-feedback recipe that uses each accepted target once per epoch, with the same replay and anchors. It gains 3.79 and 2.68 rubric points over the frozen models for 1.8B and 3B. Repeating the direct targets to the matched budget raises those gains to 7.53 and 4.61; conditional construction at that budget reaches 8.78 and 5.28. The natural-volume runs average 360 optimizer steps and 292,466 supervised target-token passes across 30 windows. Both matched-budget methods average about 620 steps and 503,638 passes. Much of the improvement comes from giving valid feedback more training exposure. Changing the examples used for that exposure provides a further gain, which the transfer and opposite-condition tests examine below.

Conditional construction adds 1.34 rubric points on transfer questions for 1.8B and 0.65 for 3B, with 95% intervals of [1.07, 1.60] and [0.52, 0.77]. On opposite-condition questions, the additional gains are 1.44 and 0.77 points. The improvement includes both carrying a behavior into a new setting and applying it selectively.

Prompting remains a useful way to provide recent feedback. Our prompt baseline selects up to four relevant feedback examples or rules, within 512 tokens. To isolate the effect of the weights, we give the trained adapter the identical history prompt used by the frozen model. The adapter adds 7.70 rubric points for 1.8B and 4.60 for 3B, with intervals of [7.09, 8.30] and [4.29, 4.91]. This comparison establishes a benefit from weight updates while holding prompt information fixed. The adapter-only results in the table measure a separate benefit, retained when that feedback history is absent from the test input.

Upper panels: paired differences in rubric points. With identical feedback prompts, the adapted model outperforms the frozen model by 7.70 points for PLM 1.8B, interval 7.09 to 8.30, and 4.60 for PLM 3B, interval 4.29 to 4.91. Conditional supervision adds 1.34 and 0.65 points over matched-budget direct-feedback LoRA-SFT on transfer questions, and 1.44 and 0.77 on opposite-condition questions. Lower panels: gain over the frozen model against cumulative supervised target-token passes. Natural-volume direct training, 292,466 passes and 360 steps, gains 3.79 and 2.68. At the matched budget of 503,638 passes and about 620 steps, repeated direct targets gain 7.53 and 4.61, and conditional supervision 8.78 and 5.28.

Figure 06. Separate weight learning from data construction. With identical feedback prompts, the adapted models outperform the frozen models. Conditional construction adds a smaller benefit over matched-budget direct-feedback LoRA-SFT on transfer and opposite-condition questions; the direct baseline already accounts for most of the improvement. The lower panels distinguish natural-volume direct training from repeated direct training and conditional supervision at the matched target-token budget, which is not total compute. Gains are relative to the same-size frozen model; intervals are 95% profile-bootstrap intervals, paired for the upper contrasts.

The held-out responses make these distinctions concrete. A lesson about prioritization during a child’s illness transfers to a family transport problem. The adapted 1.8B model identifies the missing deadline before proposing alternatives. Feedback on natural social openings changes how 3B responds at a cross-team lunch. In a separate boundary case, it suggests a brief acknowledgment when a speaker says they have to leave. The behavior depends on the situation even when the underlying lesson is shared.

Figure 07. The same lesson in unfamiliar situations. Held-out responses before and after adaptation, under the same test input. The examples span prioritization, social communication, and technical explanation. The update in each case contains multiple examples; the displayed feedback is one source of supervision. The technical input itself asks for an example first.

Technical explanation reveals a useful limit. After feedback on gradient accumulation, 3B gives a more concrete explanation of cache invalidation. That held-out prompt already asks for an example first, so the change shows better execution of the requested style. A separate unequal-microbatch question still receives an incorrect mathematical answer. Improving how a model explains something does not establish that it has learned the underlying mathematics.

Together, the aggregate comparisons and responses support learning across held-out situations within these eight skill families.

Choosing the learning signal

The main results establish that supervised updates can turn feedback into useful behavior. We next examine whether a different learning objective makes better use of the same local training time. SFT learns from an accepted response, one target token at a time. In demonstration-conditioned self-distillation, a teacher receives an example that the student will not see at inference time. The student learns from the teacher’s distribution over continuations, including alternatives to the demonstrated answer.

We compare three methods on the 960-event development set. Direct-feedback LoRA-SFT repeats repaired answers to fill the new-example schedule. Conditional-data LoRA-SFT uses repairs, condition-preserving variants, and boundary examples. The third method uses those conditional examples as demonstrations for a LoRA adaptation of self-distillation fine-tuning, or SDFT.2 All three receive the same source-event stream, replay and anchor allocation, adapter layout, and number of optimizer steps. SDFT adds student rollouts and teacher-distribution evaluations, so equal optimizer-step counts do not imply equal token counts or total compute.

For each SDFT example, the student generates a response from the training input alone. The teacher receives the input, the demonstration, and the student’s response prefix at each position. We minimize full-vocabulary reverse KL, DKL(pθ∥qθˉ)D_{\mathrm{KL}}(p_{\theta} \parallel q_{\bar\theta}), at the prefixes visited by the student. The teacher distribution is stop-gradient. Teacher and student share the frozen base and use separate adapters, with the teacher adapter updated after each optimizer step by an exponential moving average, 0.98 of its previous weights plus 0.02 of the student’s. The EMA carries across windows. This setup uses the model’s demonstration-conditioned predictions to supervise its own continuations; it does not add a larger external teacher or an auxiliary supervised loss.

Each trajectory covers ten windows of 24 optimizer steps, with six profiles and three seeds per model and method. We test peak learning rates of 2 × 10⁻⁵, 5 × 10⁻⁵, and 10⁻⁴. The comparison below fixes the peak rate at 5 × 10⁻⁵, with warm-up and cosine decay within each window. To observe the learning dynamics, we retain every research candidate without activation-gate filtering. The curves in Figure 8 show how these candidates perform as training proceeds. The 30-window results elsewhere in the article follow the accepted-adapter protocol and use a separate held-out evaluation.

Training loss alone cannot rank these methods. SFT minimizes cross-entropy on demonstration tokens; SDFT minimizes KL on its own sampled continuations. A smaller numerical value for one objective says little about its advantage over the other. We instead measure teacher-forced negative log-likelihood on the same fixed, held-out assistant targets for all methods. This common NLL tests whether updates make those targets more probable. Separately generated responses establish whether the change improves task performance.

Scroll to compare all columns

ModelLearning methodNLL (nats/token) ↓Task pass rate ↑General probe Δ
PLM 1.8BDirect-feedback LoRA-SFT2.33369.70%−6.51 pp
PLM 1.8BConditional-data LoRA-SFT2.22074.75%−3.21 pp
PLM 1.8BConditional-data LoRA-SDFT2.29071.53%−2.73 pp
PLM 3BDirect-feedback LoRA-SFT2.09774.86%−6.42 pp
PLM 3BConditional-data LoRA-SFT1.97479.91%−2.30 pp
PLM 3BConditional-data LoRA-SDFT2.00878.33%−1.69 pp

These are means over 18 profile-seed trajectories after ten windows. Task scores use a fixed 240-question development bank per profile; general retention uses a separate 128-item probe, with changes in percentage points from the frozen model. Conditional SFT improves both common NLL and task pass rate over repeated direct feedback. Its task pass rate also finishes ahead of SDFT by 3.22 percentage points for 1.8B and 1.57 for 3B. SDFT loses slightly less general-task performance in both sizes. The two objectives favor different parts of the adaptation–retention trade-off.

On the tested Apple-silicon paths, median window time is 299 seconds for conditional SFT and 692 for SDFT at 1.8B; at 3B, it is 388 and 914 seconds. Student rollouts and teacher-distribution evaluation bring median SDFT window time to 2.32× that of conditional SFT for 1.8B and 2.36× for 3B. At a 30-minute budget, conditional SFT leads SDFT in task pass rate by 6.34 percentage points for 1.8B and 4.70 for 3B. We select the last completed checkpoint within the budget for every trajectory. Faster methods have processed more feedback windows by then, so this comparison measures how efficiently the complete learning procedure advances through an experience stream. The ten-window endpoint above compares methods after the same stream.

An inset contrasts the two learning signals: LoRA-SFT applies cross-entropy to the tokens of an accepted target, while LoRA-SDFT samples a student rollout and matches, at each student prefix, the full-vocabulary distribution of a demonstration-conditioned teacher with reverse KL. Below, for PLM 1.8B and 3B at the reference peak learning rate, held-out NLL falls over 240 optimizer steps and ends at 2.333, 2.220 and 2.290 for 1.8B and 2.097, 1.974 and 2.008 for 3B, for direct-feedback SFT, conditional-data SFT and conditional-data SDFT. Against cumulative update time, at 30 minutes the task pass rates are 69.10, 71.97 and 65.63 percent for 1.8B and 73.56, 75.25 and 70.56 percent for 3B. Ten windows take about 36 to 44 minutes for direct SFT and 106 to 132 for SDFT on 1.8B, and 45 to 58 and 133 to 172 minutes on 3B.

Figure 08. Learning from the same feedback, at different costs. Three learning methods on six development profiles and three seeds per model, at a fixed peak learning rate of 5 × 10⁻⁵. Upper panels evaluate the same held-out assistant targets after every four optimizer steps. Lower panels use each run’s last completed checkpoint within each update-time budget; methods can process different numbers of feedback windows in the same time. A mean is drawn while all 18 runs are inside the budget; dots mark where each run completes ten windows, and holding a method shows its runs in full. Update time includes data construction, student training, rollout, teacher computation, and window-close work, with the base already resident; research-only evaluation is excluded. Every candidate is retained in this experiment. Bands shown on hover describe the 10th–90th percentile across recorded runs, not confidence intervals.

Learning rate changes the comparison. At 10⁻⁴, conditional SFT and SDFT reach 81.13% and 80.76% task pass rate on 3B, a much smaller gap. SDFT at this higher rate also exceeds SFT at the reference rate. Neither method’s reference setting should therefore be treated as its best achievable score. The additional adaptation has a retention cost. Doubling conditional SFT’s peak learning rate from the reference raises task pass rate by only 0.14 percentage points for 1.8B and 1.23 for 3B, while general-probe declines grow by 4.34 and 5.03 percentage points. At the lowest tested rate, conditional SFT’s general-probe decline stays below one percentage point in both sizes, with lower personal-task scores.

For PLM 1.8B and 3B, task pass rate against general-probe change after ten development windows, for three methods at peak learning rates of 2 × 10⁻⁵, 5 × 10⁻⁵ and 10⁻⁴. Raising the rate generally raises task performance and deepens the general-probe decline. At the reference rate, conditional-data SFT reaches 74.75 and 79.91 percent with changes of −3.21 and −2.30 points, and SDFT 71.53 and 78.33 percent with −2.73 and −1.69. At 10⁻⁴ on 3B, conditional SFT and SDFT reach 81.13 and 80.76 percent. Direct-feedback SFT at 10⁻⁴ falls to −16.84 and −16.49 points.

Figure 09. The learning-rate trade-off. Task performance and general-probe change after ten development windows, for three fixed peak learning rates per method. Each point averages six profiles and three seeds. The general probe contains 128 shared development items and is separate from the final ten-suite evaluation. Higher learning rates can improve adaptation while increasing capability loss. The reference rate is a working point, not each method’s best achievable setting; connected points are measured configurations, not a fitted frontier. Hover or tap a point for its values.

The results favor conditional SFT for the local-learning budget we study. Well-constructed targets provide a strong learning signal without the rollout and teacher costs of distillation. SDFT retains an advantage on the general probe, and its task performance approaches SFT at a higher learning rate. The original SDFT study also reports a weaker result than SFT at 3B on its Science Q&A task and links the method’s scaling behavior to the teacher’s in-context learning ability.2 Our comparison measures the practical trade-off for PLM, where time spent sampling and evaluating a teacher competes with time spent learning from further feedback.

Learning across repeated updates

A useful adaptation method must keep learning when feedback changes subject. Our streams interleave skills over 30 windows, include a gap in new social-opening feedback, and change the default response depth from concise to detailed. Later requests for a brief answer apply only to that exchange. These changes test whether the model can accumulate useful behavior while remaining responsive to what the person wants now.

On the fixed 48-question probes, conditional-data adaptation averages a gain of 5.03 rubric points for 1.8B and 3.22 for 3B across the update windows. This equal-window average captures improvement during the learning process, including rejected updates, alongside the stronger final-checkpoint result. It uses the same probe questions throughout; the 240-question endpoint tests provide the broader assessment.

Retention is measured against behavior that remains useful. A lasting change invalidates incompatible old training targets, which are removed from future replay. A one-off request changes the desired response for that input while leaving the broader default intact. Boundary examples teach the current request to take precedence. This distinction matters because repeatedly training contradictory targets would make the optimizer responsible for resolving a contradiction in the data.

We track earlier behavior on six fixed probes in each of the seven skill families whose requirements remain valid, using window 5 as the reference. For each skill family, the retention metric counts a drop from that reference and clips improvements to zero, so progress in one skill family cannot offset regression in another. At window 30, the mean drop is 0.01 rubric points for 1.8B and 0.05 for 3B. Matched-budget direct-feedback SFT also retains these earlier behaviors well. The small drops support preservation on this probe set during further learning; they do not distinguish conditional construction as a better retention method.

Current intent is evaluated separately because its requirements can change. The default shifts permanently from concise to detailed at window 17; requests for brevity in windows 24–26 apply only to the current task. On the six fixed current-intent probes per profile, full-credit rates at window 30 reach 95.8% for 1.8B and 100% for 3B. These are scores on the current-intent dimension, independent of whether the complete answer passes the task. Figure 11 follows both probe sets through the stream, alongside the final general-capability assessment.

Replaying a small set of earlier examples is a well-established approach to continual learning.3 Our reservoir holds up to 512 examples, stratified across the eight skill families. To examine its role alongside general-capability anchors, we compare three training mixtures on six development profiles over ten windows and three seeds. All use conditional construction with matched input-token passes, supervised target-token passes, and optimizer steps. New-example-only training fills all 96 schedule slots with current supervision. Once earlier examples are available, the replay-only recipe uses 64 new exposures and 32 replay exposures; the mixture with anchors uses 64 new, 16 replay, and 16 anchor exposures.

Replay raises the personal-behavior gain from 4.11 to 5.79 rubric points for 1.8B and from 2.79 to 4.10 for 3B. Yet the separate 128-item general-capability probe still declines by about four percentage points in both sizes. The mixture with anchors reaches the same personal scores while reducing that decline to 0.17 and 0.61 percentage points for 1.8B and 3B. In this comparison, rehearsing personal feedback helps accumulate the trained behaviors, while examples outside that feedback distribution protect broader capabilities. The final study tests the selected recipe over a longer stream and a wider general-capability evaluation.

Three matched-budget mixtures over ten development windows: new examples only (96 new exposures), new examples with replay (64 new and 32 replay), and new examples with replay and anchors (64 new, 16 replay and 16 anchors). Personal-behavior gain rises from 4.11 to 5.79 rubric points for PLM 1.8B and from 2.79 to 4.10 for PLM 3B when replay is added, and stays at 5.79 and 4.10 with anchors. The general-probe change is −3.99 and −4.08 percentage points without anchors and −0.17 and −0.61 with them.

Figure 10. What replay and anchors preserve. Three matched-budget mixtures on six development profiles over ten windows and three seeds. Replay improves personal-behavior gains, while the mixture with general-capability anchors reduces decline on a separate 128-item general probe. Personal gains have 95% profile-bootstrap intervals; general-probe dots show seed-averaged profiles, joined across recipes, and the bar marks their mean. The first window has no replay; its mixtures use 96/0/0, 96/0/0, and 64/0/32 new/replay/anchor exposures, respectively. This development comparison is separate from the final evaluation in Figure 11.

We evaluate general capability with the adapter enabled across ten suites, covering instruction following, mathematics, commonsense reasoning, code, Spanish, tool use, and behavioral boundaries. The macro average gives each suite equal weight. At window 30, conditional-data adaptation changes this score by −1.93 percentage points for 1.8B and −1.76 for 3B. These are small average declines alongside the personal-behavior gains, although individual tasks can decline more. The 1.8B MATH-500 result falls by 3.19 percentage points, and the 3B ARC subset falls by 4.25 percentage points.

The uncertainty matters for a stronger retention claim. The one-sided 95% lower bounds are −2.34 and −2.15 percentage points, outside our predefined two-percentage-point noninferiority margin. The results therefore support substantial retention, with a measurable trade-off. Freezing the base weights makes an update reversible; it does not guarantee that the adapter preserves every capability while active.

Upper rows, for PLM 1.8B and 3B over 30 update windows. The mean drop of still-valid earlier behavior below its window-5 reference stays under a quarter of a rubric point for both direct and conditional SFT and ends at 0.01 and 0.05 points for conditional SFT. Full credit for current intent stays at 75.0 and 85.4 percent for the frozen models and rises to 95.8 and 100 percent with conditional SFT, across the lasting switch to detailed answers at window 17 and the one-off brief requests in windows 24 to 26. Lower rows: at window 30, all ten general suites change between −0.21 and −4.25 percentage points; the macro average changes by −1.93 and −1.76 points, with one-sided bounds of −2.34 and −2.15, beyond the −2-point noninferiority margin. MATH-500 falls 3.19 points for 1.8B and ARC-Challenge 4.25 for 3B.

Figure 11. Keeping earlier learning while responding to new requests. The upper rows track earlier behavior and current intent during continued updates. Earlier-behavior decline is measured against window 5 on fixed probes in the seven categories whose requirements remain valid, with score improvements counted as zero decline. Current intent separately measures the share of fixed probes receiving full credit on that dimension; lilac marks identify scheduled feedback changes, not measured recovery times. Intervals resample profiles after averaging training seeds. Below, ten general-capability suites are evaluated with the adapter enabled at window 30. Their equally weighted macro declines have one-sided intervals extending beyond the predefined two-point noninferiority margin. Each panel retains its own scale and evaluation set.

Both model sizes absorb successive rounds of feedback using a fixed-size adapter while preserving most of their initial general capability. Longer histories will test how replay selection, adapter placement, and rank affect the quality–capacity trade-off. The 3B model begins closer to the ceiling of this suite, so its smaller numerical gain alone does not imply that it learns less effectively.

Training on personal computers

Local weight updates place different demands on a device than inference does. Training must retain activations, compute gradients, and hold optimizer state. Freezing most parameters reduces that burden, but gradients still pass through the frozen network to reach the adapters. A small adapter file is only one part of the memory budget.

We use quantized frozen bases for the computer training paths, following the approach of backpropagating into higher-precision adapters through a low-bit base model.4 On Apple silicon we use an MLX-based affine-quantization path; on Windows we use CUDA with NF4. The tested configurations pair 1.8B with a 16 GB unified-memory Mac or an 8 GB VRAM Windows GPU, and 3B with a 32 GB Mac or a 12 GB VRAM Windows GPU. Throughput also depends on the specific hardware and software configuration within these resource classes.

The training loop accounts for only part of the wait. A usable update also requires constructing and checking examples, loading the model, saving and exporting the adapter, and evaluating the candidate for activation. For the standard workload, the median active time for a complete local update is 12.8–22.2 minutes across the four paths, excluding scheduler pauses. Figure 12 separates this full cost from training time and shows the variation between runs. Transfer to the phone and loading there are additional stages.

Four computer paths. Full local updates over 20 warm runs take a median of 17.4 minutes for PLM 1.8B on a 16 GB Mac and 12.8 on an 8 GB VRAM Windows GPU, and 22.2 and 16.7 minutes for PLM 3B on a 32 GB Mac and a 12 GB VRAM Windows GPU; the 95th percentiles are 25.8, 21.6, 31.6 and 23.4 minutes. Training alone takes medians of 5.6, 4.5, 7.5 and 5.5 minutes. In one recorded run near each median, constructing and verifying examples and the activation gate each take several minutes beside training. Peak memory medians are 7.31 and 10.20 GiB of process footprint on Mac, and 4.85 and 7.04 GiB of GPU-resident memory on Windows.

Figure 12. The cost of a complete local update. Full local update times (active time, excluding scheduler pauses) across 20 warm runs per path, with median and 95th-percentile values; training times are reported separately on the lane below. The standard workload uses 64 new-example exposures, 16 replay exposures, and 16 anchor exposures per epoch, for two epochs. Full local time includes construction, validation, model loading, training, saving, export, and the activation gate; the stage bar is one recorded run near each median, and its stages add up to that run’s total. Memory measures process physical footprint on Mac and GPU-resident memory on Windows.

The current resource results favor scheduled learning when the device is idle. In concurrent-work tests, scheduled training still raises foreground p95 response latency by roughly 29–49%, depending on the configuration. The runtime can stop submitting new training work and resume a saved update, but it cannot immediately interrupt an accelerator kernel already in flight. Short training sessions between periods of active use are a better fit for these measurements than continuous, invisible background training.

After training, we export the adapter against the exact base model, tokenizer, and target-module layout expected by the phone runtime. The adapter is tied to that model version and size. Quality is checked again after training quantization and after export, because a good computer checkpoint does not by itself establish a good phone deployment. On a separate 240-question phone evaluation, the adapter improves rubric score by 6.79–7.79 points across the four paths. Training quantization and export each incur losses of roughly half a point to one point in their paired stage comparisons. The remaining gain survives deployment.

Two lanes. The personal computer constructs and validates examples, trains a candidate, and exports and checks it, while the phone keeps the last accepted adapter available for inference. In this case the candidate is accepted: the compatible adapter is transferred, loaded, and becomes the next accepted adapter on the phone. Below, an independent 240-question phone evaluation: the exported adapter raises rubric scores by 7.79 and 7.58 points for PLM 1.8B trained on Mac and Windows, and by 7.50 and 6.79 for PLM 3B. Training quantization changes scores by −0.83, −0.92, −0.63 and −1.00 points, and export by −0.71, −0.58, −0.79 and −0.54.

Figure 13. From a computer update to an adapted phone model. The computer prepares and checks an update while the phone retains the last accepted adapter. An accepted, compatible version can then be transferred and loaded for later inference; a rejected candidate never reaches the phone. The lanes show order, not measured durations, and transfer and phone loading are outside the local update time in Figure 12. Below, each row compares the exported base and adapted models on an independent 240-question phone evaluation. Training quantization and export changes are reported separately from those gains; these scores are not the main desktop learning benchmark.

Learning and conversation run on different schedules. A personal computer can spend minutes incorporating feedback while the phone keeps the last accepted adapter available for inference. The next accepted version carries the changes in the same fixed-size adapter, ready for later conversations. Feedback can be turned into training data and used to update the adapter locally, without a hosted training service in the update path. This gives local learning a practical place in the Personal Intelligence Layer.

A shared model supplies the starting capability. What a person teaches their copy of it should stay with that copy, and the longer histories ahead will test how far a fixed-size adapter can carry it as the person’s expectations change. Two people who begin with the same model should, after a year of use, be working with two different intelligences, each shaped by a life the other does not share. A model that develops where it is used is where that difference begins.

Sources

  1. Edward J. Hu et al. LoRA. Low-Rank Adaptation of Large Language Models, 2021.

    Back to text ↑
  2. Idan Shenfeld et al. Self-Distillation Enables Continual Learning, 2026.

    Back to text ↑
  3. Arslan Chaudhry et al. On Tiny Episodic Memories in Continual Learning, 2019.

    Back to text ↑
  4. Tim Dettmers et al. QLoRA. Efficient Finetuning of Quantized LLMs, 2023.

    Back to text ↑