[ZK Stack] - prover compressor got panicked - "Couln't allocate host buffer"

[moneta]

Team or Project

No response

Module Affected

• System contracts (era-system-contracts)
• Smart contracts (era-contracts)
• zkEVM (era-zk_evm)
• Server (zksync-era)
• Prover (era-boojum)
• Fee withdrawer (era-fee-withdrawer)
• Block Explorer (clock-explorer)
• Portal - Wallet + Bridge (dapp-portal)
• Other (please specify below)

Rust Version

1.85.0

Operating System

• Ubuntu
• MacOS
• Windows
• Other (Please specify below)

Issue Description

We can see that a prover compressor picks up job in the table proof_compression_jobs_fri and try to process it. However, it quickly throws error "Couln't allocate host buffer"

Here is the log messages:
`
2025-03-03T17:39:18.516788Z INFO zksync_proof_fri_compressor: Starting proof compressor

2025-03-03T17:39:18.646525Z INFO zksync_proof_fri_compressor::compressor: Started proof compression for L1 batch: L1BatchNumber(3)
thread 'tokio-runtime-worker' panicked at /home/prover/.cargo/registry/src/index.crates.io-6f17d22bba15001f/fflonk-cuda-0.152.11/src/primitives/mem.rs:80:13:
Couln't allocate host buffer

2025-03-03T17:39:20.729554Z ERROR zksync_queued_job_processor: Error occurred while processing ProofCompressor job L1BatchNumber(3): "Couln't allocate host buffer"`

Expected Behavior

The compressor should compress proof successfully

Current Behavior

The compression job failed to process with the above error. In the database, job status is updated from queued to failed

Repository Link (if applicable)

No response

Additional Details

No response

Prior Research

• Yes, I searched for similar issues and did not find any matching ones.

[cytadela8]

Looks like memory allocation issue. How much vRAM does your GPU have? compressor requires 20GBs at least.

[moneta]

Thank you for your reply. My GPU has 16GBs. I am going to find a 20G to deploy the proof compressor and try again. I will keep you updated.