reflector.go

LBRYFoundation/reflector.go

Fork 0

mirror of https://github.com/LBRYFoundation/reflector.go.git synced 2025-09-20 18:09:52 +00:00

Commit graph

68c0fe3b97

Merge pull request #68 from lbryio/modular_reflector master Niko 2025-08-22 02:22:03 +02:00
8bfe7e101d fix tests Niko Storni 2025-08-22 02:05:55 +02:00
7b3cca45b4 update readme Niko Storni 2025-08-22 01:56:39 +02:00
ad710dfeea fix livelock Niko Storni 2025-08-22 01:34:56 +02:00
ebc52245f3 fix viper for real Niko Storni 2025-05-14 01:17:13 +02:00
b098aa2dc8 stupid viper... Niko Storni 2025-05-14 00:58:37 +02:00
ddd23f9a36 fix config loading bug Niko Storni 2025-05-14 00:25:48 +02:00
4928e430c0 fix bugs Niko Storni 2025-05-13 22:52:40 +02:00
d21b0867dd remove unused cmds Niko Storni 2025-05-13 22:30:40 +02:00
32a85a815e adjust s3 configuration Niko Storni 2025-05-13 18:01:28 +02:00
9cdac902bd add multiwriter store Niko Storni 2025-05-13 14:47:19 +02:00
8ec01bf1a7 fix tests Niko Storni 2025-05-13 14:37:51 +02:00
ba8d1ba67b add s3 sharding Niko Storni 2025-05-13 14:08:33 +02:00
edecf4f988 delegate cascading for blocker and missing blobs checker Niko Storni 2025-05-13 13:55:54 +02:00
77836f9c83 prepare stores for reflector upload Niko Storni 2025-05-13 05:54:46 +02:00
9716e41d63 replace hub servers with valid ones Niko Storni 2025-04-25 20:04:50 +02:00
7260388255 make servers modular Niko Storni 2025-04-25 17:39:52 +02:00
071a7907c1 Refactors store implementations for config loading Niko Storni 2025-04-24 05:11:52 +02:00
185900582d add support for sharding in http stores Niko Storni 2025-04-19 04:21:46 +02:00
03445476ec rename stores to better reflect what they do Niko Storni 2025-04-19 03:49:54 +02:00
e5a9590cb6 make s3 endpoint configurable Niko Storni 2024-12-16 22:35:50 +01:00
de736b068d remove outdated linter Niko Storni 2024-04-09 20:00:46 +02:00
14fbd2ae27 update dependencies Niko Storni 2024-04-09 19:17:32 +02:00
4d81a43a8f update dependencies Niko Storni 2023-10-11 21:01:37 +02:00
b3f0d63b4d fix bug Niko Storni 2023-10-11 20:52:13 +02:00
c880f0b80f fix bug rendering sf useless Niko Storni 2023-10-11 20:45:31 +02:00
085490e92b upgrade go version Niko Storni 2023-07-07 15:34:22 +02:00
456fe53e01

Merge pull request #67 from lbryio/upgrades Niko 2023-03-09 13:12:59 -05:00
778fc17adf update readme Niko Storni 2023-03-09 18:59:21 +01:00
e93c097fd9 upgrade dependencies Niko Storni 2023-03-09 18:41:41 +01:00
0dfda70c70

Merge pull request #63 from lbryio/declare_err Niko 2022-10-17 19:01:56 +02:00
6c082993cf metrics: declare request is too large Victor Shyba 2022-10-14 15:21:06 -03:00
08ed3c9f13 metrics: declare invalid blob hash len Victor Shyba 2022-10-14 15:18:46 -03:00
7f75602841 metrics: declare protected blob Victor Shyba 2022-10-14 15:16:54 -03:00
4d168ddefc metrics: declare invalid json request Victor Shyba 2022-10-14 15:15:32 -03:00
b7abb77ea1

Merge pull request #62 from lbryio/declare_err Niko 2022-10-14 19:45:40 +02:00
8c2a46752c declare errInvalidPeerData on metrics Victor Shyba 2022-10-14 14:42:22 -03:00
0c8da4abe5 Merge remote-tracking branch 'origin/peer_proto_tests' Niko Storni 2022-10-14 18:30:08 +02:00
87680d806c check for valid data earlier. reply composite as tests are expecting Victor Shyba 2022-10-11 22:58:41 -03:00
e1c59b9b63 test through the connection Victor Shyba 2022-10-11 22:57:52 -03:00
c79634706b ignore server closed errors the right way Niko Storni 2022-09-23 14:46:55 +02:00
f5d30b1a6e update quic-go Niko Storni 2022-07-30 20:10:28 +02:00
0177dd4ce0 fix query param Niko Storni 2022-07-29 05:40:50 +02:00
5693529216 protect protected content Niko Storni 2022-07-29 04:59:15 +02:00
a1c2e92ca3

Merge pull request #57 from andybeletsky/fix-store-macos Niko 2022-05-12 16:01:00 +02:00
9c0554ef05 Do not use direction package on macos Andrey Beletsky 2022-05-08 15:24:55 +07:00
4e80f91a57 fix memory leak Niko Storni 2022-05-04 19:14:20 +02:00
c211f83ba7 update dependencies Niko Storni 2022-05-02 23:32:29 +02:00
29d1ccf68c add singleflight to web requests Niko Storni 2022-05-02 23:07:22 +02:00
2f7d67794f remove debug leftover Niko Storni 2022-02-10 00:57:13 +01:00
4d8e7739d7 Merge branch 'fix-ci' Niko Storni 2021-12-14 22:36:01 +01:00
6fc0ceea2a adjust travis vars Niko Storni 2021-12-14 22:35:44 +01:00
ae0c7dd2bb upgrade quic-go for go1.17 Niko Storni 2021-12-14 20:49:50 +01:00
4af5c2f4c6 make slack channel configurable Niko Storni 2021-10-30 00:21:58 +02:00
def0a97f49

Update readme.md Alex Grin 2021-09-28 10:15:24 -04:00
6dde793745 do not delete blobs for blocked content Niko Storni 2021-09-21 18:00:55 +02:00
654cc44935 Merge branch 'hash_twice' Niko Storni 2021-09-21 16:21:25 +02:00
90d6d29452 remove all hashing on the download path Victor Shyba 2021-08-02 11:56:55 -03:00
b2272fef3a delete overflowing blobs from underlying cache Niko Storni 2021-08-18 19:36:47 +02:00
86f3e62aa8 fix a panic error Niko Storni 2021-08-05 17:47:20 +02:00
71fb06fbb8 sendfile proof of concept sendfile Victor Shyba 2021-08-02 03:23:54 -03:00
e1b4f21e00

Merge pull request #52 from lbryio/ittt Niko 2021-07-23 20:35:22 -04:00
b4913ecedf cleanup Niko Storni 2021-07-24 00:08:13 +02:00
63a574ec2f unify caches Niko Storni 2021-07-23 23:44:21 +02:00
b8af3408e0 move server packages Niko Storni 2021-07-23 22:35:41 +02:00
847089d0d6 fix error propagation Niko Storni 2021-07-22 20:13:05 +02:00
170dfef3a8 fix copy pasta mistake Niko Storni 2021-07-22 04:09:16 +02:00
2b458a6bd0 fix params Niko Storni 2021-07-21 18:32:48 +02:00
febfc51cb0 refactor refactor refactor Niko Storni 2021-07-20 02:09:14 +02:00
72be487262 Fix broken import Andrey Beletsky 2021-07-15 18:37:40 +07:00
94e7d81bd3 Fix OpenFile call flags for macos Andrey Beletsky 2021-07-15 18:23:06 +07:00
c6c779da39 fix panic Niko Storni 2021-06-12 00:56:57 +02:00
2e101083e6 write blobs to tmp dir to avoid corruption Niko Storni 2021-06-07 23:03:10 +02:00
63aacd8a69 use O_DIRECT to write to disk (fixes everything) Niko Storni 2021-05-28 01:19:57 +02:00
c03ae6487d fix unsafe dereference Niko Storni 2021-05-21 21:06:59 +02:00
0c4f455f0c add metrics Niko Storni 2021-05-21 19:09:02 +02:00
af3e08c446 update lbry.go dep Niko Storni 2021-05-21 18:05:37 +02:00
975bfe7fac upgrade singleflight Niko Storni 2021-05-21 17:58:33 +02:00
b075d948bb remove locks causing deadlocks Niko Storni 2021-05-21 05:53:13 +02:00
2651a64dbb add http server/client Niko Storni 2021-05-21 05:49:02 +02:00
fa7150cf2b Add queue to prevent writing too many files at once. Mark Beamer Jr 2021-05-20 20:43:01 -04:00
6c4db980c9 Add queue to prevent writing too many files at once. Mark Beamer Jr 2021-05-20 20:41:47 -04:00
7adaa510fd Add locks to disk store. Mark Beamer Jr 2021-05-20 19:59:50 -04:00
64ed7304f6 add a lot of extra heavy debugging Niko Storni 2021-05-21 01:48:46 +02:00
5aefaf061e Add single flight for cache not just origin Mark Beamer Jr 2021-05-20 19:05:48 -04:00
724ee47c8b add metric calls for other packages Mark Beamer Jr 2021-05-20 18:12:30 -04:00
caaec6fcb1 add guage metrics for go routines in reflector package Mark Beamer Jr 2021-05-20 18:01:13 -04:00
15984b8fd9 add gops to reflector server Mark Beamer Jr 2021-05-20 17:21:35 -04:00
2be913b077 request queue size param Niko Storni 2021-05-20 23:17:18 +02:00
34c11b0a0e increase window size Niko Storni 2021-05-06 22:53:18 +02:00
64acdc29c3 improve disk cleanup Niko Storni 2021-04-29 03:41:18 +02:00
598773c90d fix mess with lbry.go Niko Storni 2021-04-13 00:52:56 +02:00
766238fd7e add if this than that store Niko Storni 2021-04-12 23:05:50 +02:00
ac5242f173 add integrity check cmd Niko Storni 2021-04-07 04:46:18 +02:00
215103cb33 use wait group not stopper Mark Beamer Jr 2021-04-06 14:28:29 -04:00
ed3622d0a6 Wait for request to be handled before returning Mark Beamer Jr 2021-04-06 14:21:05 -04:00
848fce5afa Add request queue for blob cache Mark Beamer Jr 2021-04-06 14:00:36 -04:00
e37eeba0c9 check blobs when reading them Niko Storni 2021-04-05 23:34:45 +02:00
7da49a4ccb upgrade quic-go Niko Storni 2021-03-31 04:53:27 +02:00
7b02ace5e2 fix issues caused by beamer's renaming Niko Storni 2021-03-29 19:56:18 +02:00