• Recursively chunks all files in a directory tree.

    This is a convenience function that combines getDirectoryStructure() and chunkDirectoryStructure() into a single operation. It traverses the directory tree, identifies all files, and chunks them based on the provided delimiter.

    Parameters

    • rootPath: string

      Absolute path to the root directory to process

    • options: DirectoryStructureOptions & {
          charsPerToken?: number;
          delimiter?: RegExp;
          maxTokensPerChunk?: number;
      } = {}

      Options for directory traversal and chunking

    Returns ChunkedDirectoryNode

    Hierarchical structure with all files chunked, including position metadata

    // Chunk all files in a directory with default settings
    const result = recursively_chunk_directory('/path/to/project');
    // Chunk only TypeScript files, split on 3+ newlines
    const result = recursively_chunk_directory('/path/to/src', {
    delimiter: /\n{3,}/g,
    fileExtensions: ['.ts', '.tsx'],
    includeHidden: false,
    maxDepth: 10
    });
    // Access the chunks
    result.children.forEach(node => {
    if (node.type === 'file') {
    console.log(`File: ${node.path}`);
    node.chunks.forEach(chunk => {
    console.log(` Lines ${chunk.startLine}-${chunk.endLine}: ${chunk.content.substring(0, 50)}...`);
    });
    }
    });