Skip to content

Adds connection keep-alive and response compresion to RPC calls. #167

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Adds connection keep-alive and response compresion to RPC calls. #167

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
c6ffaf9
Adds connection keep-alive and response compresion to RPC calls.
Feb 7, 2025
ddf7571
Prettier.
Feb 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 11 additions & 11 deletions src/config.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -145,10 +145,10 @@ export const SCRAPER_MODE: ScraperMode =
process.env.SCRAPER_MODE === undefined
? DEFAULT_SCRAPER_MODE
: process.env.SCRAPER_MODE === 'BLOCKS'
? 'BLOCKS'
: process.env.SCRAPER_MODE === 'EVENTS'
? 'EVENTS'
: throwError('Wrong SCRAPER_MODE');
? 'BLOCKS'
: process.env.SCRAPER_MODE === 'EVENTS'
? 'EVENTS'
: throwError('Wrong SCRAPER_MODE');
export const METRICS_PATH = process.env.METRICS_PATH || DEFAULT_METRICS_PATH;

export const PROMETHEUS_PORT = getIntConfig('PROMETHEUS_PORT', DEFAULT_PROMETHEUS_PORT);
Expand Down Expand Up @@ -389,13 +389,13 @@ export const FEAT_UNISWAP_V2_PAIR_CREATED_EVENT = getBoolConfig(
export const UNISWAP_V2_PAIR_CREATED_PROTOCOL_CONTRACT_ADDRESSES_AND_START_BLOCKS = process.env
.UNISWAP_V2_PAIR_CREATED_PROTOCOL_CONTRACT_ADDRESSES_AND_START_BLOCKS
? process.env.UNISWAP_V2_PAIR_CREATED_PROTOCOL_CONTRACT_ADDRESSES_AND_START_BLOCKS.split(',').map((contract) => {
const [name, factoryAddress, startBlock] = contract.split(':');
return {
name,
factoryAddress,
startBlock: parseInt(startBlock),
};
})
const [name, factoryAddress, startBlock] = contract.split(':');
return {
name,
factoryAddress,
startBlock: parseInt(startBlock),
};
})
: [];

if (
Expand Down
8 changes: 7 additions & 1 deletion src/data_sources/events/web3.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ import { Web3Wrapper } from '@0x/web3-wrapper';
import { RawLog } from 'ethereum-types';

const Web3 = require('web3');
const Web3HttpProvider = require('web3-providers-http');

export { BlockWithTransactionData, BlockWithoutTransactionData, Transaction, TransactionReceipt } from './web3_updated';

Expand All @@ -32,8 +33,13 @@ export class Web3Source {
private readonly _web3Wrapper: Web3Wrapper;
private readonly _web3: any;
constructor(provider: Web3ProviderEngine, wsProvider: string) {
const web3HttpOptions = {
keepAlive: true,
headers: [{ name: 'Accept-Encoding', value: 'gzip' }],
};

this._web3Wrapper = new Web3Wrapper(provider);
this._web3 = new Web3(wsProvider);
this._web3 = new Web3(new Web3HttpProvider(wsProvider, web3HttpOptions));

if (BLOCK_RECEIPTS_MODE === 'standard') {
this._web3.eth.extend({
Expand Down
Loading