| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
examples : fix typo mismatch in gpt (#1349) | 1 年前 | |
examples : fix typo mismatch in gpt (#1349) | 1 年前 | |
GGUF: C++ refactor, backend support, misc fixes (skip) (llama/11030) ggml-ci | 1 年前 | |
mnist : adapt to opt changes ggml-ci | 1 年前 | |
metal : add perf-metal tool + fix build | 2 年前 | |
examples : add tokenization tests and refactor codes (#186) * examples : [refactor] remove unnecessary lines and segments * examples : [feature] add tokenization test for gpt-neox * examples : [feature] handle multibyte character set * examples : [refactor] find the longest token for word * examples : [refactor] move test_tokenizer to common.cpp as the function affects other models * add 'test_tokenizer' function after loading the model * examples : [feature] add test cases for checking tokenization * examples : [feature] tokenize with huggingface tokenizers for currently supported models * examples : add tokenization test cases for each model * revert conversion from string to utf-8 encoded byte strings * [refactor] make util functions for testing tokenizers available * [bug fix] test replit using functions and variables (e.g. tokenizer struct, tokenization method) defined in its main.cpp * [refactor] modify function name test_tokenizer -> test_gpt_tokenizer * [refactor] put parenthesis on single line for-loops and if-statements * [refactor] withdraw <filesystem> and use <iostream> and <dirent.h> * [refactor] remove 'find_test_file' function and directly set test file path from 'test_gpt_tokenizer' function * call a function for testing tokenizer with filename specified * revert test tokenizer in replit (replit uses seperate methods for tokenzation and decoding) * compare vector of id to check if two tokenizations are identical. * write token ids instead of strings. * [refactor] use --token_test rather than --test for token-test argument * add english test cases * update test cases with more english prompts * examples : tokenizer testing fixes --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> | 3 年前 | |
ggml : remove ggml_graph_import and ggml_graph_export declarations (#1247) The implementation is already deleted with commit 9d0762e. closes: #1235 | 1 年前 | |
sam : remove redundant layout copies in the image encoder and mask head (#1654) | 15 天前 | |
typo: init_model does not create tensors (#1572) | 2 个月前 | |
cmake : add config version support (#1582) * cmake : add config version support (wip) [no ci] This commit adds support for find_package using a version, for example: ``` find_package(ggml 0.19.0 REQUIRED) ``` examples/test-cmake has been updated to use this and build scripts have been added to verify this manually. This is still a work in progress and I'm not sure about the scripts and if we can find better ways to test this but it might be useful to have for verification of changes to the cmake build. * cmake : add semver to ggml backends [no ci] This commit adds a semver to the ggml backend modules files. The motivation for this is that the backends are currently loaded just a file extension, for example .so on linux. With the introduction of semantic versioning installing a new version should just work but since these files don't have a version they would get overwritten. Adding the semver to the library names allows multiple version to be supported and the correct one will be loaded by the code. I've only tested this on linux and need to test on mac and win. * Revert "cmake : add semver to ggml backends [no ci]" This reverts commit 53a6c58a07591951324c891b9986b2cffe5c7972. * examples : update build-install.sh and set GGML_BACKEND_DIR | 2 个月前 | |
examples/yolo: fix load_model memory leak (#1432) | 7 个月前 | |
yolo : add support for dl backends (#1251) | 1 年前 | |
common : adapt to q2_0 (#0) | 3 个月前 | |
ggml, whisper : sync whisper.cpp (GGML_FTYPE + Q5 WASM SIMD) | 3 年前 | |
common : fix for two functions when top_k exceeds the vocabulary size. (#1633) | 1 个月前 | |
examples : add --print-confidence option to cli (whisper/3150) * examples : add --print-confidence option to cli This commit adds a new command-line option `--print-confidence` to the whisper-cli. When enabled, this option prints the confidence level of each token in the transcribed text using ANSI formatting codes. The confidence levels are represented using different styles: ```console main: confidence: highlighted (low confidence), underlined (medium), dim (high confidence) ``` Refs: https://github.com/ggml-org/whisper.cpp/issues/3135 | 1 年前 | |
examples : add sample SAM inference (#74) * sam : image + prompt encoder, store embeddings * sam : add the dense img pe in SAM state (#401) * Add SAM decoder & output masks as png (#418) * Add loading of decoder layers in Model * Multiply by hypernet_layer_cnt for ctx_size on model load * Add decoder layers to py conversion script * Fix wrong and reversed tensor sizes for decoder * Add decoder transformer implementation * Add decoder hypernet and iou prediction mlps * Add transpose convolution operation and unit test * Finish mask decoder and write the decoder output in the model state * Output masks to png after removing padding and upsampling to original size - Also filter based on the iou treshold - Additionally filtering based on the stability score and crop boxes should be done * Add stb image write in order to output masks from SAM * Add transpose convolution 2d name and symbol to ggml ops static arrays * Comment out debug print in transpose convolution test to fix compilation ggml-ci * Multithread GGML_OP_ADD_REL_POS operation * ggml : fix GGML_OP_NAME array * Disable and comment out debug prints in SAM example * Add README for the SAM example * Calculate & filter based on stability score and calculate bounding box ggml-ci --------- Co-authored-by: Yavor Ivanov <yivanov@viewray.com> | 3 年前 | |
examples : add sample SAM inference (#74) * sam : image + prompt encoder, store embeddings * sam : add the dense img pe in SAM state (#401) * Add SAM decoder & output masks as png (#418) * Add loading of decoder layers in Model * Multiply by hypernet_layer_cnt for ctx_size on model load * Add decoder layers to py conversion script * Fix wrong and reversed tensor sizes for decoder * Add decoder transformer implementation * Add decoder hypernet and iou prediction mlps * Add transpose convolution operation and unit test * Finish mask decoder and write the decoder output in the model state * Output masks to png after removing padding and upsampling to original size - Also filter based on the iou treshold - Additionally filtering based on the stability score and crop boxes should be done * Add stb image write in order to output masks from SAM * Add transpose convolution 2d name and symbol to ggml ops static arrays * Comment out debug print in transpose convolution test to fix compilation ggml-ci * Multithread GGML_OP_ADD_REL_POS operation * ggml : fix GGML_OP_NAME array * Disable and comment out debug prints in SAM example * Add README for the SAM example * Calculate & filter based on stability score and calculate bounding box ggml-ci --------- Co-authored-by: Yavor Ivanov <yivanov@viewray.com> | 3 年前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 2 年前 | ||
| 3 年前 | ||
| 1 年前 | ||
| 15 天前 | ||
| 2 个月前 | ||
| 2 个月前 | ||
| 7 个月前 | ||
| 1 年前 | ||
| 3 个月前 | ||
| 3 年前 | ||
| 1 个月前 | ||
| 1 年前 | ||
| 3 年前 | ||
| 3 年前 |