Skip to content

Commit bba0765

Browse files
marinegormarinegor
committed
update benchmarks and README description
1 parent 3d63504 commit bba0765

File tree

6 files changed

+262
-374
lines changed

6 files changed

+262
-374
lines changed

‎crates/bpe/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -203,7 +203,7 @@ We benchmarked the following scenarios:
203203
The data structure we built specifically for this purpose can answer those interval counting requests in typically constant times after the initial linear preprocessing of the text.
204204
This mode is not available in tiktoken, which only supports counting/encoding a complete text.
205205

206-
All benchmarks were run single-threaded on a MacBook Pro M1.
206+
All benchmarks were run single-threaded on a MacBook Air M4.
207207

208208
### Encoding
209209

‎crates/bpe/images/performance-appending.svg‎

Lines changed: 35 additions & 62 deletions
Loading

‎crates/bpe/images/performance-comparison.svg‎

Lines changed: 44 additions & 74 deletions
Loading

‎crates/bpe/images/performance-counting.svg‎

Lines changed: 35 additions & 62 deletions
Loading

‎crates/bpe/images/performance-encoding.svg‎

Lines changed: 74 additions & 86 deletions
Loading

‎crates/bpe/images/performance-worstcase.svg‎

Lines changed: 73 additions & 89 deletions
Loading

0 commit comments

Comments
 (0)