cancel
Showing results for 
Search instead for 
Did you mean: 
Highlighted
Visitor
Visitor
700 Views
Registered: ‎12-24-2017

Does CHaiDNN support different batch size

Jump to solution

The demos are only for batch=1. Is it possible for CHaiDNN with different batch size for better performance?

0 Kudos
1 Solution

Accepted Solutions
Participant
Participant
883 Views
Registered: ‎04-06-2018

Re: Does CHaiDNN support different batch size

Jump to solution

https://github.com/Xilinx/CHaiDNN/blob/bbeaf5e43a4762dd79d7915736665c970401d3a6/software/xtract/caffe_network_parser.cpp

 

if((Net->input_dim_size() > 0) && ((Net->input_dim_size() != 4) || (Net->input_dim(0) != 1)))
        {
            cerr << "[EP004] Current version requires batch size = 1 & input dimension to be in the form (1 x Channels x Height x Width)" << endl;
            exit(-1);
        }

It seems that there is no support for a different batch size right now. I don't know if there is any plan to support this. Anyway, I'm not sure you would gain a lot of performance.

View solution in original post

0 Kudos
1 Reply
Participant
Participant
884 Views
Registered: ‎04-06-2018

Re: Does CHaiDNN support different batch size

Jump to solution

https://github.com/Xilinx/CHaiDNN/blob/bbeaf5e43a4762dd79d7915736665c970401d3a6/software/xtract/caffe_network_parser.cpp

 

if((Net->input_dim_size() > 0) && ((Net->input_dim_size() != 4) || (Net->input_dim(0) != 1)))
        {
            cerr << "[EP004] Current version requires batch size = 1 & input dimension to be in the form (1 x Channels x Height x Width)" << endl;
            exit(-1);
        }

It seems that there is no support for a different batch size right now. I don't know if there is any plan to support this. Anyway, I'm not sure you would gain a lot of performance.

View solution in original post

0 Kudos