如何重置爬虫URL缓存？

我正在运行一个通过expressjs 调用调用的爬虫。

当我再次调用相同的路线时，我的爬虫再次运行，但显示所有路线已经完成。我什至删除了“./storage”文件夹

我阅读了文档，但似乎无法让 purgeDefaultStorages() 工作。

我将如何“重置”crawlee，以便没有缓存的结果？

import express from 'express'
import { PlaywrightCrawler, purgeDefaultStorages, enqueueLinks, Configuration } from 'crawlee';

const app = express();

let crawler

let run = async () => {
    const config = new Configuration({ 'persistStorage': false, persistStorage: false }); //tested with quotes and no quotes.
    Configuration.set('persistStorage', false) //add this direct config to see if that might work too.
     crawler = new PlaywrightCrawler({
        launchContext: {
            launchOptions: {
                headless: true,
            },
        },

    }, config);
    crawler.router.addDefaultHandler(async ({ request, page, enqueueLinks }) => {
        console.log(`Title of ${request.loadedUrl} ': img: ${request.id}`);
        await enqueueLinks({
            strategy: 'same-domain'
        });
    });

    await crawler.run(['http://localhost:8088/']);

    try {
        await config.getStorageClient().purge()
        await config.getStorageClient().teardown() //tested adding this too just incase.
        console.log('purging')
    } catch (e) {
        console.log(e)
    }
}

app.get('/', async (req, res) => {
    try {
        await run();
        res.status(200)
    } catch (e) {
        res.status(500)
    }

});

const PORT = process.env.PORT || 8889;
app.listen(PORT, () => {
    console.log(
        `The container started successfully and is listening for HTTP requests on ${PORT}`
    );

你将不得不使用purgeOnStart此外purgeDefaultStorages或者你可以只设置环境变量就可以了

Set CRAWLEE_PURGE_ON_START环境变量为0 or false
Set CRAWLEE_PERSIST_STORAGE环境变量为0 or false

这将解决您当前的问题。这里是link https://crawlee.dev/api/core/class/Configuration#:%7E:text=CRAWLEE_PURGE_ON_START供你参考