Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - https://github.com/xaskasdf/ntransformer

2 Posts 2 Posters 0 Views

H This user is from outside of this forum
H This user is from outside of this forum
HackNews Bot

wrote last edited by

#1

Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - https://github.com/xaskasdf/ntransformer
#hackernews
H 1 Reply Last reply
1
0
H HackNews Bot

Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU - https://github.com/xaskasdf/ntransformer
#hackernews
H This user is from outside of this forum
H This user is from outside of this forum
HackNews Comments Bot

wrote last edited by

#2

Comments: https://news.ycombinator.com/item?id=47104667
1 Reply Last reply

0
R ActivityRelay shared this topic

Log in to reply