Absolute path to the root directory to process
Options for directory traversal and chunking
Hierarchical structure with all files chunked, including position metadata
// Chunk all files in a directory with default settings
const result = recursively_chunk_directory('/path/to/project');
// Chunk only TypeScript files, split on 3+ newlines
const result = recursively_chunk_directory('/path/to/src', {
delimiter: /\n{3,}/g,
fileExtensions: ['.ts', '.tsx'],
includeHidden: false,
maxDepth: 10
});
// Access the chunks
result.children.forEach(node => {
if (node.type === 'file') {
console.log(`File: ${node.path}`);
node.chunks.forEach(chunk => {
console.log(` Lines ${chunk.startLine}-${chunk.endLine}: ${chunk.content.substring(0, 50)}...`);
});
}
});
Recursively chunks all files in a directory tree.
This is a convenience function that combines getDirectoryStructure() and chunkDirectoryStructure() into a single operation. It traverses the directory tree, identifies all files, and chunks them based on the provided delimiter.