Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft: Full quantization on runtime (WIP) #12903

Draft
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

hseok-oh
Copy link
Contributor

Call full quantization path on on-device quantization (use #11497)

@hseok-oh hseok-oh added the PR/NO MERGE Please don't merge. I'm still working on this :) label Apr 24, 2024
@hseok-oh hseok-oh changed the title Draft: Full quantization on runtime Draft: Full quantization on runtime (WIP) Apr 24, 2024
@hseok-oh hseok-oh force-pushed the draft/full_quantize branch 3 times, most recently from 63d7cc6 to fa50dd8 Compare April 30, 2024 04:16
Create and register observers on execution, not compilation.
It is more flexible and allows for more dynamic observation (ex. profile, dump on demand)

ONE-DCO-1.0-Signed-off-by: Hyeongseok Oh <hseok82.oh@samsung.com>

Remove compile option: minmax_filepath, trace_filepath

create on compile, check usage on execution

move file creation

 introduce execution config and context

Use workspace in compiler option
full quantization - use minmax-embedder

Copy embedder into odc directory: HDF5 build issue

Revert hdf5 version up and build

Use different env variable to get minmax data

rename onert_run quantize parameter

Remove hdf5 dependency on minmax embedding

restruct quantizer

restruct test library: random input generation for each run, dump

use workspace for quantization

configuration API
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
PR/NO MERGE Please don't merge. I'm still working on this :)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant