Page MenuHomePhabricator
Create Paste
Paste Active Pastes

Active Pastes
Use Results
Edit Query

  • P94808 castor save failure on catalyst / newsletter
    Started by timer
    Running as SYSTEM
    Building remotely on integration-agent-docker-1090
    (pipelinelib Docker pipelinelib-build) in workspace /srv/jenkins/workspace/catalyst-daily-Newsletter
    No emails were triggered.
    ...
    • Mon, Jul 13, 6:22 PM
    • 815 Lines
    Author: vaughnwalters
  • P94807 dbctl commit (dc=all): 'Pool test'
    --- codfw/externalLoads/pc3 live
    +++ codfw/externalLoads/pc3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Mon, Jul 13, 4:34 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94806 dbctl commit (dc=all): 'Depool test'
    --- codfw/externalLoads/pc3 live
    +++ codfw/externalLoads/pc3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Mon, Jul 13, 4:33 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94805 (An Untitled Masterwork)
    {{safesubst:
    RfA/readyToSubmit
    | user = MCE89
    | nomStatement = Example
    ...
    • Mon, Jul 13, 12:32 PM
    • 13 Lines
    Author: Jgiannelos
  • P94804 dbctl commit (dc=all): 'Change x4 masters T404715'
    --- codfw/externalLoads/x4 live
    +++ codfw/externalLoads/x4 generated
    @@ -1,10 +1,11 @@
    [
    {
    ...
    • Mon, Jul 13, 10:42 AM
    • 32 Lines
    Author: ProdPasteBot
  • P94803 dbctl commit (dc=all): 'Push x4 initial dbctl config T404715'
    --- codfw/externalLoads/x4 live
    +++ codfw/externalLoads/x4 generated
    @@ -1 +1,10 @@
    -{}
    +[
    ...
    • Mon, Jul 13, 10:33 AM
    • 28 Lines
    Author: ProdPasteBot
  • P94802 clouddb1016 x3
    Jul 13 08:26:52 clouddb1016 mysqld[2531]: 2026-07-13 8:26:52 5 [Note] Error reading relay log event: slave SQL thread was killed
    Jul 13 08:26:52 clouddb1016 mysqld[2531]: 2026-07-13 8:26:52 5 [Note] Slave SQL thread exiting, replication stopped in log 'db1154-bin.000066' at position 707869154; GTID position '0-180359179-5751637176,171966471-171966471-24,171966560-171966>
    Jul 13 08:26:52 clouddb1016 mysqld[2531]: 2026-07-13 8:26:52 4 [Note] Slave I/O thread exiting, read up to log 'db1154-bin.000066', position 707869154; GTID position 171970704-171970704-351094624,0-180359179-5751637176,171974884-171974884-1473>
    Jul 13 08:26:52 clouddb1016 mysqld[2531]: 2026-07-13 8:26:52 0 [Note] InnoDB: FTS optimize thread exiting.
    Jul 13 08:26:52 clouddb1016 mysqld[2531]: 2026-07-13 8:26:52 0 [Note] InnoDB: Starting shutdown...
    ...
    • Mon, Jul 13, 8:42 AM
    • 11 Lines
    Author: Marostegui
  • P94801 dbctl commit (dc=eqiad): 'Repooling after testing'
    --- eqiad/externalLoads/es7 live
    +++ eqiad/externalLoads/es7 generated
    @@ -3,7 +3,7 @@
    "es1035": 0
    },
    ...
    • Mon, Jul 13, 8:24 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94800 clouddb1016:3315
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db1154.eqiad.wmnet
    Master_User: repl2024
    Master_Port: 3315
    ...
    • Mon, Jul 13, 8:24 AM
    • 55 Lines
    Author: ProdPasteBot
  • P94799 clouddb1016:3318
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db1154.eqiad.wmnet
    Master_User: repl2024
    Master_Port: 3318
    ...
    • Mon, Jul 13, 8:24 AM
    • 55 Lines
    Author: ProdPasteBot
  • P94798 dbctl commit (dc=eqiad): 'Repooling after testing'
    --- eqiad/externalLoads/es7 live
    +++ eqiad/externalLoads/es7 generated
    @@ -3,7 +3,7 @@
    "es1035": 0
    },
    ...
    • Mon, Jul 13, 8:09 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94797 dbctl commit (dc=eqiad): 'Repooling after testing'
    --- eqiad/externalLoads/es7 live
    +++ eqiad/externalLoads/es7 generated
    @@ -3,7 +3,7 @@
    "es1035": 0
    },
    ...
    • Mon, Jul 13, 7:54 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94796 dbctl commit (dc=eqiad): 'Repooling after testing'
    --- eqiad/externalLoads/es7 live
    +++ eqiad/externalLoads/es7 generated
    @@ -3,6 +3,7 @@
    "es1035": 0
    },
    ...
    • Mon, Jul 13, 7:39 AM
    • 10 Lines
    Author: ProdPasteBot
  • P94795 db1217:m5
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db1164.eqiad.wmnet
    Master_User: repl2024
    Master_Port: 3306
    ...
    • Mon, Jul 13, 5:54 AM
    • 55 Lines
    Author: ProdPasteBot
  • P94794 Overrides
    mysql:research@dbstore1007.eqiad.wmnet [commonswiki]> select left(log_timestamp, 8), count(*) from logging join actor on log_actor = actor_id where log_type = 'upload' and log_action = 'overwrite' and (log_timestamp like '202607%' or log_timestamp like '202606%') and actor_name not like '%bot%' and actor_name not like '%Bot%' group by left(log_timestamp, 8);
    +------------------------+----------+
    | left(log_timestamp, 8) | count(*) |
    +------------------------+----------+
    | 20260601 | 3019 |
    ...
    • Mon, Jul 13, 1:35 AM
    • 49 Lines
    Author: Ladsgroup
  • P94793 reverted uploads
    mysql:research@dbstore1007.eqiad.wmnet [commonswiki]> select left(log_timestamp, 8), count(*) from logging join actor on log_actor = actor_id where log_type = 'upload' and log_action = 'revert' and (log_timestamp like '202607%' or log_timestamp like '202606%') and actor_name not like '%bot%' and actor_name not like '%Bot%' group by left(log_timestamp, 8);
    +------------------------+----------+
    | left(log_timestamp, 8) | count(*) |
    +------------------------+----------+
    | 20260601 | 34 |
    ...
    • Mon, Jul 13, 1:35 AM
    • 50 Lines
    Author: Ladsgroup
  • P94792 dbctl commit (dc=all): 'Depool db2209 T431950'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,6 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Sun, Jul 12, 4:01 PM
    • 10 Lines
    Author: ProdPasteBot
  • P94791 dbctl commit (dc=all): 'Promote db2205 to s3 primary T431950'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -1,13 +1,13 @@
    [
    {
    ...
    • Sun, Jul 12, 3:58 PM
    • 18 Lines
    Author: ProdPasteBot
  • P94790 dbctl commit (dc=all): 'Set db2205 with weight 0 T431950'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Sun, Jul 12, 3:51 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94789 rr multilingual log errors
    2026-07-10 10:30:08.105 1 uvicorn.error ERROR: Exception in ASGI application
    Traceback (most recent call last):
    File "/opt/lib/venv/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
    result = await app( # type: ignore[func-returns-value]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ...
    • Fri, Jul 10, 9:05 PM
    • 75 Lines
    Author: isarantopoulos
  • P94788 (An Untitled Masterwork)
    ## NTT in Singapore, we get the /24 announced and the communities are still set:
    root@cr2-eqsin> show configuration | display set | match "116.51.26.209 export"
    set protocols bgp group Transit4 neighbor 116.51.26.209 export BGP_outfilter
    set protocols bgp group Transit4 neighbor 116.51.26.209 export AS2914_out
    ...
    • Fri, Jul 10, 6:06 PM
    • 82 Lines
    Author: cmooney
  • P94785 Nokia IBGP export policy result from ssw1-e1-codfw
    ############################# BEFORE - IPv4 #############################
    cmooney@ssw1-e1-codfw> show route receive-protocol bgp 10.192.255.34 table inet.0
    Jul 10 10:35:12
    ...
    • Fri, Jul 10, 9:45 AM
    • 172 Lines
    Author: cmooney
  • P94783 My ssh config in all its glory
    Host *.wmflabs.org *.wmcloud *.toolforge.org !bastion.wmcloud.org
    User milimetric
    Host *.wmflabs *.wikimedia.cloud
    User milimetric
    ...
    • Thu, Jul 9, 6:26 PM
    • 42 Lines
    Author: Milimetric
  • P94782 Validation errors
    The following validation errors were found:
    The locale `ar` defines a translation for the string "Standard Phabricator.", however that string does not appear to be referenced by the codebase.
    The locale `ca` defines a translation for the string "Standard Phabricator.", however that string does not appear to be referenced by the codebase.
    The locale `ca` defines a translation for the string "Enable expert mode to reveal additional "advanced" options in the Phabricator UI.", however that string does not appear to be referenced by the codebase.
    The locale `ca` defines a translation for the string "Expert Mode.", however that string does not appear to be referenced by the codebase.
    ...
    • Thu, Jul 9, 4:51 PM
    • 186 Lines
    Author: Pppery
  • P94781 eventgate local test
    $ gmodena@x1-nixos-1:~/repos/mediawiki-docker/mediawiki (master) % curl -vvv http://localhost:8192/v1/events -H 'Content-Type: application/json' -d '{"$schema":"/test/event/1.0.0","meta":{"stream":"eventgate-wikimedia-dev.test.event"},"test":"hello"}'
    17:07:43.231349 [0-x] * [READ] client_reset, clear readers
    17:07:43.231489 [0-0] * [SETUP] added
    17:07:43.231534 [0-0] * Host localhost:8192 was resolved.
    17:07:43.231623 [0-0] * IPv6: ::1
    ...
    • Thu, Jul 9, 3:08 PM
    • 137 Lines
    Author: gmodena
  • P94780 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 9, 9:23 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94779 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/s2 live
    +++ codfw/sectionLoads/s2 generated
    @@ -5,7 +5,7 @@
    {
    "db2175": 300,
    ...
    • Thu, Jul 9, 9:23 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94778 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 9, 9:08 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94777 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/s2 live
    +++ codfw/sectionLoads/s2 generated
    @@ -5,7 +5,7 @@
    {
    "db2175": 300,
    ...
    • Thu, Jul 9, 9:08 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94776 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 9, 8:53 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94775 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/s2 live
    +++ codfw/sectionLoads/s2 generated
    @@ -5,7 +5,7 @@
    {
    "db2175": 300,
    ...
    • Thu, Jul 9, 8:53 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94774 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,6 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 9, 8:38 AM
    • 10 Lines
    Author: ProdPasteBot
  • P94773 dbctl commit (dc=codfw): 'codfw rack B4 repool after maintenance'
    --- codfw/sectionLoads/s2 live
    +++ codfw/sectionLoads/s2 generated
    @@ -5,6 +5,7 @@
    {
    "db2175": 300,
    ...
    • Thu, Jul 9, 8:38 AM
    • 10 Lines
    Author: ProdPasteBot
  • P94772 dbctl commit (dc=codfw): 'codfw rack B4 depool for maintenance'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,6 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 9, 8:09 AM
    • 10 Lines
    Author: ProdPasteBot
  • P94771 dbctl commit (dc=codfw): 'codfw rack B4 depool for maintenance'
    --- codfw/sectionLoads/s2 live
    +++ codfw/sectionLoads/s2 generated
    @@ -5,7 +5,6 @@
    {
    "db2175": 300,
    ...
    • Thu, Jul 9, 8:08 AM
    • 10 Lines
    Author: ProdPasteBot
  • P94770 Answer highlighting
    """
    Extractive span reader for a kNN-retrieval pipeline.
    Passages are short (a few sentences), so no sliding-window / doc-stride is needed.
    The output is ALWAYS a literal substring of the passage - there is no decoder, so
    ...
    • Wed, Jul 8, 7:28 PM
    • 104 Lines
    Author: EBernhardson
  • P94769 Highlighter Options
    # Highlighting for Semantic Search Results — Options & Phased Design
    ## Context
    CirrusSearch's semantic search path (neural query against nested `passage_chunk_embedding.knn`, per-paragraph embeddings) currently shows the **entire matched paragraph** as the snippet: `SemanticSearchResultBuilder::doInnerHits()` copies the inner hit's `_source[text]` verbatim, and `SemanticResultsType::getHighlightingConfiguration()` returns `null`. There is no sub-paragraph focusing and no `searchmatch` emphasis, unlike lexical search (WMF experimental highlighter plugin). OpenSearch's built-in `semantic` highlighter was evaluated with poor results — explainable: its stock model (`opensearch-semantic-highlighter-v1`) is a sentence classifier trained on **English-only** extractive-QA data, and the feature needs OpenSearch 3.x (prod plugins target 2.19.5). `SemanticSearchQueryBuilder` already carries a `TODO: highlighting`.
    ...
    • Wed, Jul 8, 4:13 PM
    • 90 Lines
    Author: pfischer
  • P94768 dbctl commit (dc=all): 'Pool test'
    --- codfw/externalLoads/pc3 live
    +++ codfw/externalLoads/pc3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Wed, Jul 8, 3:59 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94767 dbctl commit (dc=all): 'Depool test'
    --- codfw/externalLoads/pc3 live
    +++ codfw/externalLoads/pc3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Wed, Jul 8, 3:58 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94766 dbctl commit (dc=codfw): 'Pool test'
    --- codfw/sectionLoads/s5 live
    +++ codfw/sectionLoads/s5 generated
    @@ -9,6 +9,6 @@
    "db2211": 300,
    "db2213": 300,
    ...
    • Wed, Jul 8, 3:29 PM
    • 10 Lines
    Author: ProdPasteBot
  • P94765 dbctl commit (dc=codfw): 'Pool test'
    --- codfw/sectionLoads/s5 live
    +++ codfw/sectionLoads/s5 generated
    @@ -8,6 +8,7 @@
    "db2178": 300,
    "db2211": 300,
    ...
    • Wed, Jul 8, 3:14 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94764 dbctl commit (dc=codfw): 'Depool test'
    --- codfw/sectionLoads/s5 live
    +++ codfw/sectionLoads/s5 generated
    @@ -8,7 +8,6 @@
    "db2178": 300,
    "db2211": 300,
    ...
    • Wed, Jul 8, 3:14 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94763 dbctl commit (dc=codfw): 'Pool test'
    --- codfw/sectionLoads/s5 live
    +++ codfw/sectionLoads/s5 generated
    @@ -9,6 +9,6 @@
    "db2211": 300,
    "db2213": 300,
    ...
    • Wed, Jul 8, 2:30 PM
    • 10 Lines
    Author: ProdPasteBot
  • P94762 dbctl commit (dc=codfw): 'Pool test'
    --- codfw/sectionLoads/s5 live
    +++ codfw/sectionLoads/s5 generated
    @@ -8,6 +8,7 @@
    "db2178": 300,
    "db2211": 300,
    ...
    • Wed, Jul 8, 2:14 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94761 dbctl commit (dc=codfw): 'Depool test'
    --- codfw/sectionLoads/s5 live
    +++ codfw/sectionLoads/s5 generated
    @@ -8,7 +8,6 @@
    "db2178": 300,
    "db2211": 300,
    ...
    • Wed, Jul 8, 1:52 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94759 (An Untitled Masterwork)
    import requests
    import json
    import time
    url = f"http://alertmanager-eqiad.wikimedia.org/api/v2/silences?_ts={int(time.time())}"
    ...
    • Wed, Jul 8, 10:09 AM
    • 56 Lines
    Author: FCeratto-WMF
  • P94758 dbctl commit (dc=codfw): 'codfw rack B3 pool after maintenance'
    --- codfw/externalLoads/es1 live
    +++ codfw/externalLoads/es1 generated
    @@ -3,7 +3,7 @@
    "es2055": 100
    },
    ...
    • Wed, Jul 8, 9:31 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94757 dbctl commit (dc=codfw): 'codfw rack B3 pool after maintenance'
    --- codfw/externalLoads/es1 live
    +++ codfw/externalLoads/es1 generated
    @@ -3,7 +3,7 @@
    "es2055": 100
    },
    ...
    • Wed, Jul 8, 9:15 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94756 dbctl commit (dc=codfw): 'codfw rack B3 pool after maintenance'
    --- codfw/externalLoads/es1 live
    +++ codfw/externalLoads/es1 generated
    @@ -3,7 +3,7 @@
    "es2055": 100
    },
    ...
    • Wed, Jul 8, 9:00 AM
    • 11 Lines
    Author: ProdPasteBot
  • P94755 dbctl commit (dc=codfw): 'codfw rack B3 pool after maintenance'
    --- codfw/externalLoads/es1 live
    +++ codfw/externalLoads/es1 generated
    @@ -3,6 +3,7 @@
    "es2055": 100
    },
    ...
    • Wed, Jul 8, 8:45 AM
    • 10 Lines
    Author: ProdPasteBot
  • P94754 dbctl commit (dc=codfw): 'codfw rack B3 depool for maintenance'
    --- codfw/externalLoads/es1 live
    +++ codfw/externalLoads/es1 generated
    @@ -3,7 +3,6 @@
    "es2055": 100
    },
    ...
    • Wed, Jul 8, 8:05 AM
    • 10 Lines
    Author: ProdPasteBot
  • P94752 (An Untitled Masterwork)
    [PHP Warning] Undefined array key 1 at /srv/org.wikimedia.civicrm/core/Civi/Core/Exception/DBQueryException.php:106
    In DBQueryException.php line 106:
    [TypeError]
    ...
    • Tue, Jul 7, 6:27 PM
    • 7 Lines
    Author: Dwisehaupt
  • P94751 (An Untitled Masterwork)
    Jul 06 20:12:23 cloudvirt1071 kernel: perf: interrupt took too long (2527 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
    Jul 06 20:31:37 cloudvirt1071 kernel: perf: interrupt took too long (3174 > 3158), lowering kernel.perf_event_max_sample_rate to 63000
    Jul 06 20:59:19 cloudvirt1071 kernel: perf: interrupt took too long (3980 > 3967), lowering kernel.perf_event_max_sample_rate to 50250
    Jul 06 21:38:05 cloudvirt1071 kernel: perf: interrupt took too long (4991 > 4975), lowering kernel.perf_event_max_sample_rate to 40000
    Jul 06 22:53:36 cloudvirt1071 kernel: perf: interrupt took too long (6241 > 6238), lowering kernel.perf_event_max_sample_rate to 32000
    • Tue, Jul 7, 1:51 PM
    • 5 Lines
    Author: taavi
  • P94750 Drain CR traffic without 'graceful-shutdown' command
    # Drain active transport with OSPF Cost
    # Pre-pend routes we announce to peering and transit
    #* Also delete the 'export' policy for any specific peers completely:
    ...
    • Tue, Jul 7, 11:34 AM
    • 87 Lines
    Author: cmooney
  • P94749 llm-qwen3-14b isvc vLLM metrics
    $ curl "https://inference.svc.eqiad.wmnet:30443/metrics" -H "Host: llm-qwen3-14b-predictor.llm.wikimedia.org"
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 19606.0
    python_gc_objects_collected_total{generation="1"} 2539.0
    ...
    • Tue, Jul 7, 10:55 AM
    • 541 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94748 embeddings isvc vLLM metrics
    $ curl "https://inference.svc.eqiad.wmnet:30443/metrics" -H "Host: embeddings.llm.wikimedia.org"
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 17351.0
    python_gc_objects_collected_total{generation="1"} 2810.0
    ...
    • Tue, Jul 7, 10:40 AM
    • 551 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94747 gpt-oss-safeguard-20b isvc vLLM metrics
    $ curl "https://inference.svc.eqiad.wmnet:30443/metrics" -H "Host: gpt-oss-safeguard-20b.llm.wikimedia.org"
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 17910.0
    python_gc_objects_collected_total{generation="1"} 2773.0
    ...
    • Tue, Jul 7, 10:28 AM
    • 556 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94746 dbctl commit (dc=all): 'Repooling after reboot'
    --- codfw/externalLoads/ms3 live
    +++ codfw/externalLoads/ms3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 10:15 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94745 cope-a-9b isvc vLLM metrics
    $ curl "https://inference.svc.eqiad.wmnet:30443/metrics" -H "Host: cope-a-9b.experimental.wikimedia.org"
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 17222.0
    python_gc_objects_collected_total{generation="1"} 2967.0
    ...
    • Tue, Jul 7, 10:09 AM
    • 546 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94744 (An Untitled Masterwork)
    $ sudo cookbook sre.hosts.downtime --hours 999 'db2252*' -r 'Security updates' -t T426633
    Acquired lock for key /spicerack/locks/cookbooks/sre.hosts.downtime: {'concurrency': 20, 'created': '2026-07-07 09:48:54.331798+00:00', 'owner': 'fceratto@cumin1003 [2108947]', 'ttl': 1800}
    START - Cookbook sre.hosts.downtime for 41 days, 15:00:00 on db2252.codfw.wmnet with reason: Security updates
    Downtiming for 41 days, 15:00:00 on db2252.codfw.wmnet with reason: Security updates
    Scheduling downtime for 41 days, 15:00:00 on Icinga server alert1002.wikimedia.org for hosts: db2252
    ...
    • Tue, Jul 7, 9:55 AM
    • 10 Lines
    Author: FCeratto-WMF
  • P94743 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/ms3 live
    +++ codfw/externalLoads/ms3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 9:28 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94742 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc6 live
    +++ codfw/externalLoads/pc6 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 9:22 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94741 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc6 live
    +++ codfw/externalLoads/pc6 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 8:40 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94740 (An Untitled Masterwork)
    ALTER TABLE route ADD COLUMN backend_url VARCHAR(256);
    UPDATE route SET backend_url = (SELECT url FROM backend WHERE route_id = route.id LIMIT 1);
    ALTER TABLE route CHANGE COLUMN backend_url backend_url VARCHAR(256) NOT NULL;
    • Tue, Jul 7, 8:31 AM
    • 3 Lines
    • SQL
    Author: taavi
  • P94739 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc5 live
    +++ codfw/externalLoads/pc5 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 8:09 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94738 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc5 live
    +++ codfw/externalLoads/pc5 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 7:41 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94737 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc4 live
    +++ codfw/externalLoads/pc4 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 7:11 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94736 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc4 live
    +++ codfw/externalLoads/pc4 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Tue, Jul 7, 6:48 AM
    • 20 Lines
    Author: ProdPasteBot
  • P94735 (An Untitled Masterwork)
    content-security-policy: script-src 'unsafe-eval' blob: 'self' meta.wikimedia.org *.wikimedia.org *.wikipedia.org *.wikinews.org *.wiktionary.org *.wikibooks.org *.wikiversity.org *.wikisource.org wikisource.org *.wikiquote.org *.wikidata.org *.wikifunctions.org *.wikivoyage.org *.mediawiki.org mediawiki.org wikimedia.org *.wmflabs.org *.wmcloud.org *.toolforge.org wss://*.toolforge.org *.jsdelivr.net unpkg.com cdnjs.cloudflare.com raw.githubusercontent.com *.github.com code.jquery.com cdn.mathjax.org use.typekit.net fonts.cdnfonts.com use.fontawesome.com i.ytimg.com rsms.me doi.org localhost https://localhost:* http://localhost:* wss://localhost:* ws://localhost:* *.google.com *.gstatic.com *.googleapis.com *.translate.yandex.net yastatic.net ya.ru radically.github.io cdn.sammdot.ca cdn.fontshare.com viaf.org publicai-proxy.alaexis.workers.dev iiif.archive.org api.flickr.com live.staticflickr.com api.anthropic.com api.openai.com api.publicai.co catalogo.pusc.it parsifal.urbe.it opac.sbn.it overpass-api.de...
    • Mon, Jul 6, 6:19 PM
    • 1 Line
    Author: ssingh
  • P94734 (An Untitled Masterwork)
    (pwbvenv) tools.twn-archiver@shell-1783351633:~$ pwb login -verbose -debug
    Found 1 processes running, including this one.
    === Pywikibot framework v11.5.0.dev2 -- Logging header ===
    COMMAND: ['/data/project/twn-archiver/pwbvenv/lib/python3.13/site-packages/pywikibot/scripts/login.py', '-verbose', '-debug']
    ...
    • Mon, Jul 6, 3:34 PM
    • 858 Lines
    Author: MarcoAurelio
  • P94733 dom_walden local wiki hCaptcha config for reproduction of badloginperuser bug
    $wmgUseConfirmEdit = true;
    $wmgEnableCaptcha = true;
    $wmgEnableHCaptcha = true;
    $wmgEnableHCaptchaAccountCreationAPI = true;
    $wmgEnableHCaptchaEditing = true;
    ...
    • Mon, Jul 6, 1:28 PM
    • 340 Lines
    • PHP
    Author: dom_walden
  • P94732 cope-b-a4b isvc vLLM metrics
    $ curl "https://inference.svc.eqiad.wmnet:30443/metrics" -H "Host: cope-b-a4b.llm.wikimedia.org"
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 194669.0
    python_gc_objects_collected_total{generation="1"} 23244.0
    ...
    • Mon, Jul 6, 12:03 PM
    • 596 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94731 (An Untitled Masterwork)
    2026-07-06 11:27:08.061 3972 ERROR nova.conductor.manager [None req-56dedffc-25e4-4548-894f-13c8100975d3 novaadmin admin - - default default] Migration of instance 10457456-a444-49e9-9468-ffbdf5a73703 to host None unexpectedly failed.: nova.exception_Remote.GroupAffinityViolation_Remote: Anti-affinity instance group policy was violated
    Traceback (most recent call last):
    File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
    res = self.dispatcher.dispatch(message)
    ...
    • Mon, Jul 6, 11:58 AM
    • 505 Lines
    Author: ProdPasteBot
  • P94730 clouddb1015:3316
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db1155.eqiad.wmnet
    Master_User: repl2024
    Master_Port: 3316
    ...
    • Mon, Jul 6, 5:20 AM
    • 55 Lines
    Author: ProdPasteBot
  • P94729 clouddb1015:3314
    *************************** 1. row ***************************
    Slave_IO_State:
    Master_Host: db1155.eqiad.wmnet
    Master_User: repl2024
    Master_Port: 3314
    ...
    • Mon, Jul 6, 5:20 AM
    • 55 Lines
    Author: ProdPasteBot
  • P94726 wikimedia/shellbox: re-tag of 4.5.1 blocked
    The wikimedia/shellbox package of which you are a maintainer had an attempted
    update to version 4.5.1 blocked, because a published stable version's
    source/dist reference changed in your git repository.
    Previously published reference: 83d9a095d170d84245ea847a7ea9c8456a4cf9f0
    ...
    • Fri, Jul 3, 6:46 PM
    • 24 Lines
    Author: Legoktm
  • P94725 cope-b-a4b model-server metrics with `self.model = LLM(..., served_model_name=self.name, disable_log_stats=False)`
    $ curl -s localhost:8080/metrics
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 11359.0
    python_gc_objects_collected_total{generation="1"} 2493.0
    ...
    • Fri, Jul 3, 6:11 PM
    • 531 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94724 cope-b-a4b model-server metrics with `self.model = LLM(..., disable_log_stats=False)`
    $ curl -s localhost:8080/metrics
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 12313.0
    python_gc_objects_collected_total{generation="1"} 2527.0
    ...
    • Fri, Jul 3, 5:49 PM
    • 591 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94723 cope-b-a4b model-server metrics without `self.model = LLM(..., disable_log_stats=False)`
    $ curl -s localhost:8080/metrics
    # HELP python_gc_objects_collected_total Objects collected during gc
    # TYPE python_gc_objects_collected_total counter
    python_gc_objects_collected_total{generation="0"} 11361.0
    python_gc_objects_collected_total{generation="1"} 2490.0
    ...
    • Fri, Jul 3, 5:48 PM
    • 45 Lines
    • Bash Scripting
    Author: kevinbazira
  • P94721 Perl syntax test for "needrestart" configuration
    use strict;
    use warnings;
    use Data::Dumper qw(Dumper);
    my %nrconf;
    ...
    • Fri, Jul 3, 2:16 PM
    • 45 Lines
    • Perl
    Author: valerio.bozzolan
  • P94718 VE bugs 2015-2018
    T35080
    T39932
    T40030
    T40031
    T41621
    ...
    • Fri, Jul 3, 12:31 PM
    • 1,824 Lines
    Author: Esanders
  • P94717 Replicas with the heartbeat
    % sudo cumin 'A:db-role-slave and A:owner-data-persistence' 'pgrep -f pt-heartbeat | wc -l'
    192 hosts will be targeted:
    db[2153-2158,2160-2161,2163-2164,2166-2178,2180-2183,2186-2191,2193-2206,2208,2210-2211,2213-2214,2216-2228,2231,2236-2250].codfw.wmnet,db[1150,1154-1159,1161,1163,1165-1172,1174-1175,1177-1182,1185-1188,1190-1192,1194-1203,1205-1207,1209,1211-1212,1214,1216-1219,1221-1223,1225-1235,1237-1245,1247-1249,1251-1257,1259-1264].eqiad.wmnet,db-test2002.codfw.wmnet,db-test[1002-1003].eqiad.wmnet,es[2035-2036,2038,2040,2047-2048].codfw.wmnet,es[1036,1038-1040,1047-1048].eqiad.wmnet,pc[2018,2024].codfw.wmnet,pc[1017-1018].eqiad.wmnet
    OK to proceed on 192 hosts? Enter the number of affected hosts to confirm or "q" to quit: 192
    ===== NODE GROUP =====
    ...
    • Fri, Jul 3, 10:34 AM
    • 22 Lines
    • Shell
    Author: CWilliams-WMF
  • P94716 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc3 live
    +++ codfw/externalLoads/pc3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Thu, Jul 2, 4:08 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94715 (An Untitled Masterwork)
    2026-07-02 06:25:41.728 2571930 INFO barbican.model.repositories [-] Setting up database engine and session factory
    2026-07-02 06:25:41.735 2571930 ERROR barbican.model.repositories [-] Error configuring registry database with supplied database connection. Got error: (sqlite3.OperationalError) unable to open database file
    (Background on this error at: https://sqlalche.me/e/20/e3q8): oslo_db.exception.DBNonExistentDatabase: (sqlite3.OperationalError) unable to open database file
    (Background on this error at: https://sqlalche.me/e/20/e3q8)
    2026-07-02 06:25:41.735 2571930 ERROR barbican.model.repositories Traceback (most recent call last):
    ...
    • Thu, Jul 2, 3:47 PM
    • 259 Lines
    Author: taavi
  • P94714 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc3 live
    +++ codfw/externalLoads/pc3 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Thu, Jul 2, 3:45 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94713 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc1 live
    +++ codfw/externalLoads/pc1 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Thu, Jul 2, 3:15 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94712 dbctl commit (dc=all): 'Security updates'
    --- codfw/externalLoads/pc1 live
    +++ codfw/externalLoads/pc1 generated
    @@ -1,6 +1,6 @@
    [
    {
    ...
    • Thu, Jul 2, 2:53 PM
    • 20 Lines
    Author: ProdPasteBot
  • P94711 dbctl commit (dc=all): 'Repooling after maintenance db2205 (T426633)'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 2:46 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94710 (An Untitled Masterwork)
    $ curl -s https://cloudelastic.wikimedia.org:9243/enwiki_content/_analyze -d '{"field": "text", "text": "field of dreams"}' -H 'Content-Type: application/json'
    | jq .
    {
    "tokens": [
    {
    ...
    • Thu, Jul 2, 2:36 PM
    • 20 Lines
    Author: EBernhardson
  • P94709 dbctl commit (dc=all): 'Repooling after maintenance db2205'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 2:36 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94708 dbctl commit (dc=all): 'Repooling after maintenance db2205'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 2:26 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94707 dbctl commit (dc=all): 'Repooling after maintenance db2205 (T426633)'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,6 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 2:16 PM
    • 10 Lines
    Author: ProdPasteBot
  • P94706 dbctl commit (dc=all): 'Depooling db2205 (T426633)'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,6 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 2:09 PM
    • 10 Lines
    Author: ProdPasteBot
  • P94705 dbctl commit (dc=codfw): 'Repooling after switchover'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,6 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 2:00 PM
    • 10 Lines
    Author: ProdPasteBot
  • P94704 dbctl commit (dc=all): 'Depool db2205 T430912'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,6 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 1:55 PM
    • 10 Lines
    Author: ProdPasteBot
  • P94703 dbctl commit (dc=all): 'Promote db2209 to s3 primary T430912'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -1,13 +1,13 @@
    [
    {
    ...
    • Thu, Jul 2, 1:52 PM
    • 18 Lines
    Author: ProdPasteBot
  • P94702 dbctl commit (dc=all): 'Set db2209 with weight 0 T430912'
    --- codfw/sectionLoads/DEFAULT live
    +++ codfw/sectionLoads/DEFAULT generated
    @@ -7,7 +7,7 @@
    "db2177": 100,
    "db2190": 300,
    ...
    • Thu, Jul 2, 1:47 PM
    • 11 Lines
    Author: ProdPasteBot
  • P94701 (An Untitled Masterwork)
    taavi@runko:~ $ kdig +https taavivaananen.fi @185.71.138.138
    ;; HTTP session (HTTP/2-POST)-(185.71.138.138/dns-query)-(status: 502)
    ;; WARNING: can't receive reply from 185.71.138.138@443(HTTPS)
    ;; ERROR: failed to query server 185.71.138.138@443(TCP)
    • Thu, Jul 2, 12:12 PM
    • 4 Lines
    Author: taavi
  • P94700 (An Untitled Masterwork)
    Traceback (most recent call last):
    File "/usr/local/bin/phaste", line 80, in <module>
    res = p.call('paste.edit', **call_kwargs)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/usr/local/bin/phaste", line 57, in call
    ...
    • Thu, Jul 2, 11:24 AM
    • 17 Lines
    Author: FCeratto-WMF
  • P94699 dbctl commit (dc=codfw): 'Repooling'
    --- codfw/sectionLoads/s6 live
    +++ codfw/sectionLoads/s6 generated
    @@ -7,7 +7,7 @@
    "db2169": 300,
    "db2180": 300,
    ...
    • Thu, Jul 2, 10:42 AM
    • 11 Lines
    Author: ProdPasteBot
Next
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits