Skip to content

llama CPU phi2 model wrong generation #47

Closed
@mmoskal

Description

   Compiling rquickjs v0.4.0 (https://github.com/mmoskal/rquickjs?rev=5b0e3b24d5021d3cd4981d3693fd7bd1a106314c#5b0e3b24)

    Finished release [optimized + debuginfo] target(s) in 35.89s

built: /Users/markus/src/aici/target/wasm32-wasi/release/aici_jsctrl.wasm, 3.14 MiB

upload module... 3213kB -> 10087kB id:3508abaf

[0]: FIXED "Ultimate answer is to the life, universe and everything is "

[0]: GEN-OPT {regex: /\d\d/}

[0]: regex constraint: "\\d\\d"

[0]: dfa: 160 bytes

[0]: GEN "𝫘𝫘𝫘𝫘𝫘𝫘𝫘𝫘𝫘𝫘"

[0]: JsCtrl: done

[DONE]

[Response] Ultimate answer is to the life, universe and everything is 𝫘𝫘𝫘𝫘𝫘𝫘𝫘𝫘𝫘𝫘
 
response saved to tmp/response.json

Usage: {'sampled_tokens': 21, 'ff_tokens': 32, 'cost': 74}

Storage: {}

Activity

self-assigned this
on Feb 1, 2024
added a commit that references this issue on Feb 2, 2024
bb58408
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    llama CPU phi2 model wrong generation · Issue #47 · microsoft/aici